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Letter of Transmittal 



Funding for Innovation and Performance is one of foiuteen recommendations 
set forth in the AduU Education for the 21st Century: Strategic Plan to Meet 
CaJtfomia's Long-Term Needs. It addresses the need for new ways to finance and 
reimburse providers for alternative educational services provided under varied cmditions 
and time £rames. 

This working piq>er addresses (1) the recommendation, (2) related research and 
models that help refine our options, (3) the major policy issues and options, and (4) our 
recommendations. It is intended as a woric in progress to guide the Interim Steenng 
Committee and die funding subcommittee deliberations. The recommendations 
developed by the Steering Committee will be presented to State Superintendent of Public 
Instruction, Bill Honig, and Community College Chancellor, David Mertes. 

This working document does not necessarily reflect the views or policies of the 
California Department of Education, Community Colleges, or the Interim Steering 
Committee. 
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Edward Kissam 
Dennis Porter 
Consulting Specialists 



Adult Education Institute for Research 
and Planning 
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Executive Summary 

New ways must be found to make learning oppommities available to adults. 
Funding should allow and encourage flexibility in the timing of learning and the 
provision of instruction in a wide range of settings. The objectives of 
Recommendation 2 are to identify and test viable policies and procedures that 
facilitate and allow (1) anytime, anyplace learning; (2) public-private and cross- 
agency adult education ventures; (3) promote educational quality via bonus 
funding; (4) increase flexibility in funds allocation, and (5) stabilize funding to 
providers. 



lus (Mper iddiesiet imes concciiMng the devdopomt of 
iniovMtve «id peifiD^^ It 
coven tMGkfioand nmmh, pooibk models, poUqr oft km md 
recommcoditioni to ii nplfw i f i ni Ea co— wwi i teri oo 2. The key to acUeviof 
tUs flexiUlity and wcoomMOky is the ability to measoe i aa tni c ii o nal 
quality and to lewaid eatoelkooe in acbievtaif leaning u bj e c t im . His 
leqmies an abO^ to serve a wide laiise or adoh 
the tise of the inoft ^ifmpnaie ddiveiy systeoKs) to ^ 
leamen and the local commonity. 

Has lecommendadoopfopoees that all Cabtania lefanOess of 
age, commoDiiy, or prior edncatioiial experienoe, shorid hatve the 
oppornmity to attain basic skills, leoew oc ca pi ti o Qa l qoal il icatioa i and 
panne other self-improvemeot Moreover, cnneot ftnling policies do not 
aUow addt education provkleR to oieet cnnent dcmaml, let done pi^ 
fiitme adult edncadoD needs. The original text of the r e conwienrl ation ia: 



This recommend- 
ation proposes that 
all Caltfomia adults, 
regardless of age, 
community, or prior 
educational 
experience, should 
have the opportunity 
to attain basic skills, 
renew occupational 
qualifications and 
pursue other self- 
improvement. 



FUNDING FOR INNOVATION AND 
PERFORMANCE 

Adjust fiuiding pcdides sod mechaoisais to allow and 
encourage aiv time, any friace on-deinand instiuctioo 
through the fidlowiQg mediods: 

* Use ofinstnictiooaltecfan(dogies(e.f. computer 
assisted iostmotioa, TV courses, etc). 

* Innovatioo and nootraditional educational methods 
{e.g. tutoring, on-the-job training, etc.). 

* CoQabmtive programs. 

* Linkage of funding to perfonnanoe. 



O 
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Tlwe Me no coiM«taori*e modeU for the faidiDi 
win be needed m tbe ftnac Tbe nepoMd BA^awdm 
(Reconiiiieiid«ion4)wfflfKSltatelliinwdBldB*el^^ 

model it itae ««• ™«5f!!«» ^ 

developed by the Swe of MkWiM M p« of itt <^»»om«iy CW 



Objectives of Recommendation 



There ne five objectives to ginde the devdqmieat of the 
Tecoaunenlaiioa Iheyaie: 

(1) FacBPat«Aajtim,ABjplaGeLtarainc 

(2) ProMtcPabic-PriTiteVentvc 

(3) Use Boom Feuding to ProMOteEdMaitioiiidQaaiity 

(4) SdmaUttFIedbkAllocalioaerFUds 

(5) StabUieProvUirl^mdiBC 

These five objectives, bwed oc tbe delibentioni of the Adult 
Eduoitioo Advisosy Comninee. support tt>e devdopment (rf poHctai sod 
imoednes dui penih adutt edncaiioa pravideis fieidbiUty to 
ddivenig edocatioaBl seivioes thai reload to divene ieunei's iieeds. 



Useful Models and Proposals 



The review of usefU inodeb and proposals iadicMBS that pefConunoe 
measms can be usrd unifomily. fidriy or nentiaUy, wd peffooBaooe can 
condtte wen with deabedonioomes. There does wear to be sn exiattns 
model diat seems entiiely apptopiiaie for adnh and nonciedit education. 

However, diere are elemeiMs and eiqieiience firom die aeverd modds 
examined diat provide os^ guides. They are: 

• Perfoimance measues most take into account die dtffering 
levdstrfkanieis. 

• Petfocmanoe meanires should address die '^ralue-added"* 
by die imerventioa 

• Only one model (Tennessee) seeks to rewan! quality 
perfoimance for achieving standards. 

• Anodier model (Kfissoori) demonstrates the feasibility of 
developing "^cfa" measures of quality educadooal 
outcomes. 



fc«miM«NllaiowtodieiM»dfcoMlh»pcii«wfc«iMtn«^ Vtta tdW to ■M*f«i Iw po* iwl^ 
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l ^nHnj ftuxKiii to perfomwioe will lequiie 
developmeittl eSom to cnft a fynem t^loml to the 
gpedfic oeads of tanh «dBcaiM& 

CveM teitiiis of peifMmwoe^^ 

win be needed to dettottbe eucdy bow tteoicticaUy 

imicd^ fyHfims wamOtf dMDfe edncKiODd pioviden' 

behavior. 

TinHiig foDdkig to perfomunoe will be leqniie 
devdopmeoial eflbits to cnft a fynem tailoved to the 
q)edfic needs of idult edocttioa 



e Bffw^i^ MnkifB irf futtdipf 10 perfocMPce lecgiiiee that 
pioiiMiii be given ifae nuadmini pottibie flexib^Ucy lo 
meet peiftNnance olqeetiveB. 

Tbeie are odw develofmwM tbii aleo mM be coDiidei^^ 
fundinf ayaiemi tbM eoooonfe i mov ati oo and qoMtf peii pypanoe> In 
pnicolar d» fiowli« iniKiftanw 
bTmore pemonali»d and 11^ 
cduogion needTiart ae^ 
acooom in designing pdky opdona. 



Social and Technical Considerations 

Trends to be conadoted carefidly in ddiberidon r^aimog pQUcy 
qpdoK to fimding innovation in California adok 

(1) LeamkvTeduielotiaa. Iteimiodnciion^tf new leaning 
tednologies bns and will oooiiniie to change die 
fondmentalnttiire<tf stmctored adult learning. 

(2) Workplace and Career Change Ra qp Or e MSli TTie 
Afigmf woifcpbce tequires that woikeii in vntaaUy aU 
occowtionB have new types of -basiC* sWIr 
AddidonaDy, increases in career mobility reqmres that 
woiken acquire new capabilities to paitkvaie in lifel^ 

learning. 

(3) PopnlatkNi TNnds and ImmigratieiL Immigiation of 
foreifB-bom wodrefs widi Umitad English ability and 
literacy and Utde educational e a qierieno e creates high 
levels of demand for new edncadon aervices for adolts. 

(4) School Dropont Rales. Condnuing high rMs of junior 
and Ugh school dropout require maimenanoe of 
''lemedial** educadon services. 

These uends relate to die outcomes of adult education— die demands 
made by society <rfiu educational institudons. But diey also are assodsced 
widi how die piocess of education— how educational institutions go about 
meeting demands, both now and in die near fomre. 
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Polky Optkms Difcmied 



Elite pottcy imm «d imkm far tadioi fw lumrmim wd 



t e d iioi o ty or poo ii M HtiB ori WiHi — Iw i i i l fflnyw^ ' 

Recommended Optkms 



The d|tt poicy opdooi diMHHd an MM i m mM tee 
devekpmeoiHaSoiiiMBS. InaddMoBaarwopdonltpnpoMdio 
long 



■i 
I 



Hk nine opdoM pRMOMl Ml 1 

(1) Obtain UflM^AMlNrilj to TMtNtwMtMs. 

(2) Aitopt la tigMi t g l a dly AWprfdiMBMltiwr 



(3) De»tlopACihl«toPh«rfM«*w*««"itOftltBi. 

(4) Ptwiop ■ StUhdcrijy ff i M i M i M«<<l ft 



(5) I)e»rtop«F«t4(ir.«rTlctP«lmMMttoeMll*tM«W. 
(0 DcvtlopaStandwdiMdFtedtegM«MBMt4«ValM> 



(7) EipvtecntwilhaCaMHiaFlaBor 
OptioM. 

(8) Ulllaitte£JvCknlMtoI'Mi>t*t*P<^*'i^*^ 



(9) BigiB to Derdop a KnawMft BaM m A*Ut 

TlMiory a« It AppliM to HitiM- Oi^ PrvUia SMt 



In addition it ii itcommnwied that Optko Five be leiied in the i 
fimne. Iikawi«.ancUfconrionofOptk»6."ReimbniiePw»to 
on Value-Added," ifaooki be desgDed nd teMd. Hit opt*" 
letabom tbe provider for kairinf aeivkee b«ed toMy on a vato^^ 
meaciiBdDk. Tbe incei«ivee wodd be w«|b(cd to not poni* or lo faw 
the hMd-w^eive. The iaoendve would iocieaae ai tt>e value-added 



The coeta reimbuned would be tbe provider'i real coats father tinn a 
statewide norm and the leimbaiienent would be baaed entirrfy on viiae- 
added with couiitendy good perfofBUUKe penmtdng the provk^ 

• "profit" 
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Future Actkms 



Thtffi*»T T"''-''-*-'*''*^ «^'** «*'"l'''"' '''^«^yg^ 
ttK|nn«ithrflifr fffff THp'**^ '"^*''**'*^ 
for iuiovitiaD wA\ 




nitpipwaaeltei 
to guide tbe loMtta ~ 

jii[u'!^-iJi^?n^iMi liiiihiiiiiifiiM Vr-- mMtai: Mil HMii. 

md Oonmoirity CoO^ ChHMdkr, DiWd MeMt for nviiw ad 
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Chapter 1 

Introduction and Overview 

The use of computer-based, multimedia and other nontraditional 
instructional methods are hampered by the average daily attendance method 
of financing. Funding mechanisms must be a^usted to allow more diverse 
and flexible learning methods, and encourage program improvement. 



IPhis pepet addresses issues concennng the devdopment 
of innovative and peffbanance-based mediods to fimd adnlt 
f^hH^tyyi, It is die first in an evolvinf woddng piper on 
Stmen: Recommendsiioo 2» Pundbig far immmeOm ami 
Pnfermenee, from California's 1988-89 SMfic Flm ftr 
Aduk Education. 

This pqjcr builds on the developme nta l woik in two 
companion papers. One is Fundbig for ToiafM NeeiM 
(Recommenda^ 1). The second is the C«i|f!w«*i Sifr 
far Admit Basic EdmeeHom, which sets the param et cis forAe 
Strategic Plan imptaoMoution over die next four yean. These 
tvo papers are re fei ea c ed dironi^iout diis lepoft. Re aden are 
encouraged to review these doc um e nts for a more cmnplete 
background on die topk and die related woddng psper. 

It is inq>ortant to recognize diat diis discussion goes into 
areas where diere is Imle exp er i m ent a tion and policy 
experience. Conaequendy, diis pi^ identifies simple, readily 
underatandaUe approadies to fimding for innovation and 
performance while recognizing diat measuring leaming and 
peifMinanoe is inherendy complex. If new sppcoachet are to 
be successfol, diis complexity must not decrease die providers' 
willingness to work widi difficult-to-serve learners or weaken 
dieir commitmem to iimovaticm. 

This paper is organized into five chqiters, each building on 
the preceding. They are: 

• Introduction and Overview 

• Review of Literature and Information 

• Options to Implement Recommendation 

• Recommendations 

• Conclusions and Future Issues 
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Hie 
iasneiaid 

pcffommoc 



I pupow of tfaii inper ii to )KSm polky 
epproecfaee of ftnuUm for movMiCB aiiQ 



tuwuMwy of 



Hdi dupttr piovklet a hiMxy and 
RecotmiNiidation 2, «id identlllea its pcknny otijeetivee 



1.1 



IntrfKluction and Overview 



The overriding 
purpose of this 
paper is to isolate 
policy issues and 
options that help 
lay the ground- 
work for identify- 
ing and testing 
new approaches 
offuruUngfor 
innovation and 
performance. 



New wayi nnst be found to make a variety of kamint 
owomiuiii et availaMe to adnto. One of oar moat inpoilMt 
goab fKflitaie adote by maUng it poaiilite any tine a^ 
available in eaaiW aooeaaMt locadoDS and within aoittUa 
envtnnmmta. Thia leqaiiea Ae oae of nonir ad iii n n a l 
instnctiQaal itxaiegiBa and edn c a ti o n a l lecfanotosiea, (94- TV 
couiaea, tutorial prograott, on^-job training, c omp u ter - baaed 
insifuction, woricsite instiuction). 

HISTORY OF RECOMMENDATION 

The recommendation xegaiding funding for innovation and 
perfcmnanoe comes from id planning proceM initttted in 
October 1988 by the Adub Education Unit of tbe Youtb, Adrit 
and Alternative Educationai Services (YAAES) Dhfiiion of llw 
Califwnia Dey ai uu em of E du c a tion (CPE), b 



under die guidance of a twenty-six member Adult Edu ca tio n 
Advisory Committee appointed by State Siqmrintendent of 
PabUc Instiuction Bill Honig. 

The result was AdaU BdMcathn in tht 21it CtnUuy, 
rdeased in June 1989 as die long teim initiative to innove 
delivery, increase quality and ej^uad die scope of California 
adult education programs. In die fdl of 1989 die California 
C^ommunity Colkges began partic^)ating as full partners in die 
implementation of diis plan. 

SUMMARY OF RECOMMENDATION 

The following is the exact text of Recommendadon 2 and 
die discussi(»i diat appeared in Adult Bdmeation in tiu 2ltt 
Century} 



1 AMUBimtmm Im Dm 2ittC»iUmry, IMS-49 Adah EdmsaiieD Advitecy Commter. May 1919. pMM 65-«7. 
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meihodi. lliMpolloMfiiMpRWMlmiilMMid: 

• ADow jhodiiit for MimlUooil od^^ 
and lednoloflei tiM GW be imvkM 
aqypUoe. 

• Inacaae mpoostmmm by empowcrini indWdoria to 
acoeai flmdi and leaosmi firom dtflmot afiiirini and 
pfOfMtta* 

• AUow Md fitiamt nuncbini cuu u ib mta i i from 
individttaU, hwainfftaM, vohmaer ofaanirartnm. aod 
comnwudty gioopa* 

• Provide booaa ftndini for cxcdienoe in temia of 
ooeunooly ag aaa d vpoo FerfoimaDoe ikiaamaMMf 
aod Fkofnm QodUty Standaida. 

• Raduoe or ebmiMae diabweodves to pfovidtng needed 
itttnictioQtbat baa bifber coat. 

• ADocaie ftmda fsi^y among difierem types of 
ednctttood pioviden wiib leiaid to tte coo^^ 
itgolatiom that each pfovkkrantatiattafy. 

• Stabilize ftrndina to provklen to aqipoit staff and 
pfognun oomi nutty* 

Moat notably, ftinduif dxmld dlow and in aome caaea 
encowage flexibility in tiie timing of kmins and tlie 
proviaoo of imtractioo in a wide nn|e of sMiinp {e.g. woik 
sites, moWk teaming oenten, TV coooes, modem-linked 
computer aniited instnictioo). 



Funding 
mechanisms must 
be reassessed and 
adjusted so that 
they allow more 
diverse and 
flexible 
educational 
methods. 




ftwwiiin of ptogHMBa. 
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I " 



FUNMNO POR INNOVATION AND 
mPOlMANCI 



Atqw ■aoaig pooBM MM owGnnHM 10 now Mn 



Ute of iMMoitaMl nclmloiiii i»4. 

,TVoanM,«c.). 



tModoi, oo4»-iob tninini. oic.). 



to 



Af Of r notably, 
funding should 
allow and in some 
cases encourage 
flexibility in the 
timing of learning 
and dfie provision 
of instruction in a 
wide range of 
settings. 



Tbnc an no oeufmf mttm omcUs for the faodbig 
Noii iHt wC U Modid in flMam. H» d o — t 
BoM k te cwommry mMbfeif «d bffliig 
biinf devolopod by thi Sim of MkWpa « 
port of la OiBportow ft y Cwirf lyiiBm. SoMofttocfeH|H 
prapoMd dwvt hove bon ioftaNaiMl on • Miiil taio. 
Job tniaii« cooteied imo#i Ibe fadnl Uk tuUm 
PumenUp Act (JTPA) Md ibe CaUfonU ITiilifiiii 
Tniainf Paed ffTT) ftMl inriBi^ oa tbe Mii of 
pttfimiDCi Mtmnd in mm of Job 
IS cs^ploriof ttio ^Nfidoo oddotf^'^ ooooopt oo i 

J0llK*F0Mn AflOiaMII tmPft DOM WW ID pOOl ( 

ftmdi m the mm Md loot levd. Homm; Mfe of 
devolopiQi M iatotnMd flMUog poHcjr thit ooiMMi 
flexMttty Md MCOWuMlity ID aer^ 
be iinrtfttHlPM* 

The above discussion and text of Recommendation 3 will 
guide Ae direction this paper and subsequent research. 

OBJECTIVES OF RECOMMENDATION 



Ten different areas of adult educaticm are authorized by 
California legislation (See Exhibit 1.1). As in ttie case of 
Recommendation 1, Funding for Today^s Ni§ds, this 
recommendation proposes tfiat all CalifimiiA adults, regardten 
of age, cmmmnity, or fmor educational esqiierience, should 
have the opportunity to attain basic skills, renew occiq>ational 
qualifications and pursue other self *]m|^ Moreover, 
current fundmg policies do not allow adult educaticm providers 



2 ValHtadMftfMBlolhi 

which mMuu nhin Si^ pwy 

concept C4III89 ffOn iBflMlRftl 



hyiM^iction. SmMtidiiMnmhHUiiMaMbiciicpo»Uthcvft^ 
hMtetracdoibMUK. ValiieaddMl to nMMM«d by pra and poil Mint or Mni 

md 6wn faxnion fatmnlt which idd wtM to imwrfacfwri imm t—ch ol 
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to tobti Cttirant donand, let alom ^pim for future acfailt 
education needs. 

Exhibit 1.1 

THE TEN AUTHORIZED AREAS OF INSTRUCTION 



• EBgltok^M•S«MldLaM>a•«OESL) 

• VocattoudiyalBiiv 

• Profran for OUar Adults 

• HifhSckoolLenlBaiicSUUs 

• ElaaiMtarySckoolLeTdBasicSkillf 

• PartatEducatloa 

• CitiMiiaUpEdMation 

• Health and Safety iMtruction 

• Home EcoBOOiia 



The objectives identified in Recommendatioii 2 fonn die 
initial paxameteis for reaearch and analyss. The 19M-49 
Adult Education Advisoiy Conunittee noted die need to 
develop an integrated fundhig policy comlnning flexibOity and 
accountabSity. This woddng pq>er is die first stqi in ditt 
process. 

The objectives of Reconvnendation 2 are to identify and 
test viable policies md {aroceduies that will facilitate and aUoiw 
(1) anytime, anyplace learning; (2) puUic-private adub 
education vemures; (3) promote educational quality via bonus 
funding; (4) increase flexibility in funds allocation, and 
(5) stabilize funding to providers (See Exhibit 1.2). 
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Exhibit U 

OBJECTIVES OF RECOMMENDATION 2 



FAODLir ATE ANYTIME, ANYPLACE LBAINING: 

• MaktitpMriUtiN-BrvfMmtonmrcwti 
inoPTtd li mrtlriiiit I mmtU Mtmj tj9tm» 

imtMs aad ttchMloiiit 

• PMotedilb«79ilnMtkirt alow worlds aMts 
to iMTMit tlM ttM tkij iavwt ia karaiag 

PROMOIE FUBLIC-PUVATB VENTURES WHICH: 

pnbUc ud prhnrte ttclM- 

• EqidteMy combine AuNling from muttiple pvblk 

• Ittcrcam emuatUag Bad wyp m U T C lenrkot to 

USE BONUS FUNDING TO PROMOTE EDUCATIONAL 
QUALTIT: 

• StrngthoiiocentiTesforoiitstoiidingpei^^ 
by proridtrs 

• Rewird sacctsiftd tauMmitioa 

• Encounge senrke to the hard-to- terre 

• Limk performance incenthres to achieTing detired 
ontcomes 

STIMULATE FLEXIBLE ALLOCATION OF FUNDS 
THAT: 

• Prraiotes local planning and needs asfeesment 

• Snpports dlmsiflcation of program des^ and 
deihrery models 

• Target resources to learner needs 
STABILIZE PROVIDER FUNDING TO: 

• Strengthen program continuity 

• Stimulate local planning and resource mobilization 

• Suppwt iuTestmoito in staff development 



The five objectives of Recommendation 2 are elaborated on 
the next page: 
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Effective public- 
private ventures 
require the ability 
to efficiently and 
equitably mix 
public and private 
resources. 



FacState Anytime, Anyplace Learning. The 

of cc 



learning symam md fim e ni e af«» oe ci: lantti- 

new inwii OQi of oodpniE no coit fooovny to 
(1) putdmat iMKObiic iw i j i^mw , (2) depndtte 
i» oae, (3) iqpfnide or pmo^dSky lOj^ioe it, 
(4) pudiase or Bcooie the oMesMfy foftwtte 
and (5) piovide die neoMtaiy staff ai9poit aie 
neoessaiy. 

Encoonge Publie-Private Vmturcs. The 
ability of die adah educarion lyatenno aqipoct 
private aector and odier baadc kanraif and 
ictiaaiing can incnaae in inportauoe if 
approuiate iriinhBiieniont niediodt are 
availdde. Effiacdve pnblicinvai* veoiiimi 
reqniie die MSky to emdeody and eqioiably 
m]xpid)licand|X]¥aieioaoiiioes. Lfloewiae adok 
edocMion piovideis ahodd be enoo««|ad and 
rewaided for liddng their aervicea ftmctionally 
and creativdy wm other human aenrioe 
pnmdeis to devdop more compidiensive 
sendee deliveiy systems. 

Use Bonus Funding to Promote Educational 
Quality. Pdides diat reward (pudiiy of 
instniction and reward providers who make 
q)ecial efforts to instnict die hard-to-aerve are 
needed ADA based funding is insofficknt to 
guide diis ^iproach. 

Stimidate Flexible Funds Allocatim. Prior to 
Propo si tion 13, local taxes su pported 44 percent 
of aduh school and noncredit mstruction. Now 
the State funds more dum 90 percent of 
instniction in the 10 andioitDed areas. It 
regulates reimbursement levels, funded areas of 
instracdon and controls growth.^ This state 
control discourages local needs assessment and 
analysis regarding learner needs and priorities. 



dM Advil BdM«iioolMt,CdtfQrakDtp«tM int.eMmUnmdtmOtmton^PMjOftkmP^^mFmmJImg 

MT^^fN€^,A^hladmc^otihmifmm,Hudii. 1990. 
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Stabliize Provider Funding. It it inponant that 
polides wjcwniging pwtom a p c g b tta d or 
flerible laiiBbmieBiBOt yw«dha> d8 
it moR rfifltailt <o ptan Innnwi B u rt iBOf UHW , 
and maiD kms mc tta mA iMte long mm 
dedaioBt ngaidiig« iiKfliiiat mA gyip m B m , 
Tliis ragfoiis iMliBg polidM that lewatd 
inatractionil qpudky nd retain a *\mits of 
service'* qifxoach are wof% of esploraiiaii. 



These five otqectives, baaed oo the delibeniaaas of the 
Adult Education Advtaory Committee, aoppott the 
development of policiea and procedi t i ea th at pa qrit adnit 
edncation providen fleilbiliiy in d e i i g win g and dtttvenng 
edacationai aeivices diat reapood to divene knner't needs. 



The Icey to adiieving thia fbsdiaS^ and a cc oon ta bil ity ii 
die iMlity to meaame inatmctienai quality aad to sewaed % 
exceUeoce in achieving learning o t ifB c t i ve a . Thia leqaina an «^ 
abflity to serve a wide lange or adnh leameis, and to omange 
die nae of die moat ap propr iate ddiveiy syawmCa) to meet the 
needs of die learners and die local community.' Hie fbOowinf 
sections provide dK badcground and recommendadona to 
begin ftis process. 



' ReconHNwlMian 7. QmMy Stmtim^i mtiPtffmimm* Unmutt, and Ihe reMltiiis polkiw Md prooodum wUI |«idt iMwh of 
Ihii dtvalopmtiKal weifc. 
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Review of Literature and 
Information 



There is an increased interest in "value-added" and other measures 
of performance. At the same time Oure are limited examples of innovative 
and performance-based funding to use as guides. 



JL hexe is both t growiag intew« m ro etfiods to evdMi e 
the efifectiveness of edu c a ti o n and a linted aqpply of models 
which have appUatiaa to an open enity^— open ct« 
eu v ir o nmeot. TWi chapter (1) leviewa and smnmanBea *e 
general literature c mw y ming modds and reaem a op; 
subject, (2) disciiaws new devetopmenis and co n aid c i raiinn ^ 

(3) analyzes chaa^png social and economic needs, and 

(4) presents die key findings. 



This section reviews the literature and background of 
public sector experiences in devdoping funding policies 
^i^iich fc^er innovation and perfbonance in human aennce 
programs. It addresses iunovarion in service delivety, creative 
collaboration between stakeholden in load communities, and 
die use of emerging instroctianal tedhnologies. 

Over the nesct 20 years there will be substantial preswres 
from die private sector, elected officiab and die general public 
to demonstrate die effectiveneas of adult education and training 
investments. The nrfe of the public and aoaptoSx sectws as the 
presunqxive deliverers of diese services will be senkwaly 
dudlenged. This is die result oi several convergnig forces: 
(1) die demands for a more productive wodc force in die face 
of global competition; (2) die general acceptance 1^ learners 
and die pi^iUc diat learning is lile4ong; (3) die improvements 
in madiine centered instruction, training and nttoang 
capabilities; (4) expanded puhlic-privare education and 
training coUabwations, and (5) an exjdosim in alternative 
learning and education q)portunities. 



Chapter 2 




2.1 



General Background 
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These forces will ir«?f**t>*» poldk pdiqr Msntkn on Ae 
efibctiveoBSS, efficiency mm cqaky of pobiic iiKiKinwMi in 



aduk edncttion, tniDinf and reminiBg and the imnhlr 
ahemMives to pieeent noidM. One omoome wfil be the 
l eq uiw rnent th« leninf providen (kmonsUM their 
rffectivenessmdeUverintaemoee.' This wffl be done tfanvgh 

linking ftitwiinj aatA parftifwiiee me— iiM. 

These changes wiU not come easily. In an envirouuent 
wfaete dme is bat one or two service pionders, theit has been 
no provider interest in UaUng perfbfn tnce and fending. 
Providers object to this added scratiny. Most smdhrand 
analysis has focused on uw aa uring die kaming avvls 
learners, instncion, otfatr reaoarces) Mher Aan the 
oatoomes {e.g. learning gains, costs and benefits). 

While there has been graoAiing and minor cKperimeniatioa 
to teat mi^ ahenaadvea, asriom afljorn to link fondfeag and 
peifonuanoe have not bean anenfiied. This cc 
envirooment vHien poaaUe nfoms go iii >n s tiid and ] 
for massive restmctnring leautt 

For example, this reality haa led to the cnnent coooovany 
regarding "stndent choice" piognms in grades K-IX Mm 
C3mbb of the Bn)oidi«s ItMHtoooB condndea that Us itad^ of 
20,000 stndanis, teachen and prindples ia a sanpla «f SCO 

nnent has i 



— - — — » a r ^ , 

K-12 scboob shows thtt govamDMntnas not solvad the 
tion problem becaase edacadon ir the piobkm.* QMMb 
that becanae schools are ssswtlaWy a monopoly, they ham 
become burdened wkfa eKiaasiw bureaacracy and have atiflad 
student achievement. He aigiies for a madoei^oioee amoidi 
based on school competition and parental choice as me only 
wi^ to reinvigorate pablic education. 

PROS AND CONS OF AVERAGE DAILY 
ATTENDANCE APPROACH 

The traditional method for reimbursing aduh education 
piovideis is '*«verage daily attendance" (ADA). In dw case of 
adult schools one unit of ADA is the equivalent of 325 stndett 
attendance hours. Reinrimrsement rates are tied to this unit 
measure.' Ceilings for eadi i»ovider in terms of ADA units 
have been established. They are periodically adjusted by 
legislated mttltq>liers. 



WMliiB|>wiD.C 



^ RiiiMiiMiiiriu I tiit for Todi/i N«di". Sm liiMiiN^ Dmmu FaHhf /it Hm^ WwMNf 

Fmtr m Sm atm it >mw iB 7 . Afal Bd^E Hi M U^Htm for Ummtk md VUm^ Smiw m I b, March 3. 199a TUtf 

] J Imiir fuliin Ini ii iiri r!r"'"r ^ ^ r ^ " ^a^a^^^tt . at.^ — ^- j l^iMlMitMi|cii 

for *i M«l 19 faKiMM tiw l0««l ol adak tdM^ioo IMiBS. 
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It is dear ilM more ictoorcei •!« needed to tenre tiw «Mire 
state ndnMttbedeaund for eervioee.^ This ADA sffmch 
woks xeasodriity wdl. It givea ihe provider t dear baeis for 
plttBinf moooe aUocadona, adwdBlint ciM iea, aad 
desifoiDg cankolom. While tto m dear toeqeite anwai 
disticts and aome parts of the naie fo onaerved, the ADA 
modd has become a comfawa h k method for planninf . 
estimating aid preparing for adnlt edncatioD. 

The ADA nnoadi comae firom the K-i2 system where 
8tiidentteiei«|^«d. for the most part, to be in school IntUs 
cooMct anndsnn is a dmpk and equitable meaanie of 
persons participating in i 



However, in the case of the adult learner other prmdplea 
apply. Moat inpartMdy the adnh learner partidpana 
voittmarily in edncstkm. Ik or she is not required to be a 
certified learner, nor to attend learning eessions. 

It is important to examine the pros sod cons of using the 
ADA fondiag ^iproach for adpk edocatiaQ before discuasing 
altemadves to it Exhibit 3 sets fordi n andysis of the proa 
and coos of the ADA spproadi to adnh education 

reim buf se m g it . 

On balance, there are two positive aspects of the ADA 
approadL They are die hiatoricd pcecedem based on die 
K-12 modd for fonding and die eeee of use, esoedaUy for 
planning. The makr disa dva maa ea are: (1) me inpUdl 
dismcentives to sernng die more dfficult learner. (2) ttllo 
demonstrated rdationtfrip between eeat time and leamiBC, 
(3) the aeat time approach is hard to tf^y to urtr adi t to w^ 
adult educatioa approaches, and (4) no link between fonding 
and pefforuuuKe. 



* D«wo». FmmdImtM T94ty'iNm4$: WtrUmgHptrmStMHtk Ki t i m m mi^ in l.lUi. Mi. Dm««» niAw • »«T |«» 
cw«farMpMidn|lhtteAt«. TUi NM«ch Mid andym, liM wffl te nviMd to iacl«di MBmmi^ 
MTMt « an inpMiMit bwk(ra«ad to iliit pi^. 
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ExhiUta 

PROS AND CONS OF ADA FUNDING 



PROS 

(1) Funds distributed on eqnal cost bttis statewide. 

(2) Providers can pUa and allocate resources based 
on dMir expected ADA aad CAP. 

(3) Funds can be allocated among die ten audiorized 
areas baaed on local need. 

(4) Unoited restrictions on bow fonds are used. 

(5) Easy to administer. 



CONS 

(1) Fuuds do not reflect real operating costs. 

(2) Disincentives to serving die hard-to-serve 
{e.g. equity). 

(3) Funds not related to individual or institutional 
outcomes {e.g. petfbonance and effectiveness). 

(4) No current relation between local demand and 
resources («.g. funds distribution across the 
srate). 

(5) Disincentives for high productivity 
{e.g. efficiency). 

(6) T ^ymimg measured by hours of attendance 
{e.g. effectiveness, efficiency and equity). No 
incentive to measure learning gains and 
peifoimance. 

(7) Presuinption of class centered learning 
{e.g. elGfectiveness, efficiency and equity). 

(8) Inq)propriate for untraditicmal tpptowdbes like 
con^uter-based, distance learning, or volumeer 
tau^metfiods. 
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THE FOR INNOVATIVE 
FUNDING APraOACHES 



OverOie 
past 20 years, 
there has been 
growing concern 
regarding cost- 
reimbursement 
as a basis for 
funding of human 
services. 



Approiciiof 10 iiinnn wm 
mcthodi f f • wngio diUjr MM 
two c: -y: (1) fmfmSA " 
ftnMciM Of wKvot dittwy 

d efin ed inm yquimg^i 



if 




on 



at a 



of 



The tndiiiaoal penpeciive on 
acfaievmf sodiity dartiaMii |otb 
not sfEKtivQ 




^^^^^^^^^^^^^^^^^ ^ ^^s2tf^^b^^X^^^^B^WA A^^^k ^^^^^^^^^^^^^^^^^^^^^ ^K^^^^A^^^^^ 

ODjecuvot** ffiJHiiiciiqr» mo pifwiMiiiiwiii iiwig xBgnmssk 
ui60 oy OOP poviic iocwf fWBHwnropy »ig ino pnouc fociof 
for nqppon <rf for bnman wvioo pmnms his ben coit* 
reiiDbuiiciiitiit for sopport coiH incunod* 

Over die pMt 20 yean, tfieio has been fiowinf coooem 
r^aidin^ coec-foniibiisMoieQt ti a beau for ftwidim of hnnan 
servicea. Thia conoem aiema m pst fiom poblk an 
sentiiuent diat hmnaii aervioe faiaiiHtf Iom be mora aooowtabte» 
not ody for doing the **riijM dupg,*' bat alao for aooceedim. A 
valid argument ondediea Aia wave of political aa ntimeitt . 
Becauae public aector reaooioea are limted« vtitnally aU 
fonding requires choices among various competiqg goods. 

In the field of healdi care, for example, diia concern haa led 
to new fonding approaches tyiqg reimboiaamant to "^niii^of 
service'* (services deliveied, not underiyiqg coaia inconad). 
While diere is consensus that qoaL^ heddi care is a vafaiaUe 
objective, lack of accountabili^, it ia argned, nu^ not only 
decrease cost-effectiveness but may actually decrease quality 
of service.'^ 

There has been a growing recognition that die aodety must 
support avariety of 'linnian capital*" devdopment goals iirtiile 
at ^ same time aeeking innovative aervice delivery mediods. 
Funding tied to outcomea radier dian fonding tied to inputs, 
(e. ''cost reimbursemenfO stems, in large measure, from the 
reidization diat diere are new, innovative, and radically 
different ways to accompli^ *'oid** objectives.* 



ThaltiHiidio 



ti./Mf. 

TIm PrivM NiNi Ihofil Sttdof.** ScltiM#a Miy 5, 19§9. 



from MM 10 WM. TbopoKcy 



(IMtO^) Of ili of Mfytco** ii Hwt <»y m% praMrily orknud 
DRCI% «t vaKd wMi rMpoct 10 ADA, 00 both cfMo. 

boofc. Tim Vmitmn ii| ^>or. (fmAi^ l9i9)cofMelly idtaijftitilioiite«iiidiflkokft«m 
•hoold |«idi todol poKcy dKlriont (too oipoctolly pofot 79^1 23). 
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The need 
to tie fiuiding 
to outcomes, 
not inputs, is 
inevitabfy 
accelerated 
when promising 
new technologies 
become available. 



For tTtMiwift, As Ikicd FoundiBOP's vciy Uiuim wpp p it fiv 
"adBCttkad tetevbion'* to tte 1970*1 mmtmoA mm 
rocojniiioo thif cftiUbfe ttohDolofy pravidid omt mQpt M 

funded Buy DO knter be pM of lenriot diliva^ 

Trarthinnrily ed uciii o n hai retiiwd perfomaaoe-bitid 
fundmgbecttie: (1) qadter it dttBenh to mBMue. (2) iheee 
is no adequiB n wM uie of edncnioa d iMceit, «f 0) « 
^obil ontoooM iuvolvtof ooi qbI^ 'lie develflpoMni of ^>iC'iBc 
aidllt but taringlhiii ihe love of toiatoi, onaiiQr, 
crBativity---isdfficali to define. Yec,toieeettnin,tbaft]Ne 

^-^^^^^^ ^^^^^^^^^^^^^ ^^^^^^^^^^^^w^^^^^^^ ^^^(^kA^^^^A ^^^^^^^^^^^^^^^^ ^^^^A 

oocn gnywmg ptmuuiwy in imnBf miKwiiw» si 

coQccpc 01 vmio iopoo nMnvn oi im ptifuiimttw of 
edacational inaiiuiiu u > , 

nwiSunng IDC ooofMCX onnoomci or wiDrincwiii mwvcbpop is 
duKt porfommoMdiiod OMmimkwiil inoQMhnBi nny CoMf 
innovation ev« if Ae pommaoe menaw doat wt fb^y 
captDxedieridBietsof thaooMome. This ia pMMft beeanaa 

UJC IHBISIIIbS en u^kIIHIIIHIGB GIhV DB HIBEBHe IBIMM MB 

f or the edncadooal ovicoinaa iiriiidi aie Tfaia 
perapecdve reoognizaf diat all danbad teamkig ontcomaa mqr 
be veiy difficult to measoie (Sracdy. 

To be effective, a perfonnanoe-baaed ayatam nmat: (1) be 
used unifbnnly, (2) be "fu^ or *tatral,** md (3) cqmlaiia 
performance measoies weU widi daaii^ lliaae aia 

the minininm conditions. Additional criteria may be yaad to 
judge wbedier a paiticular appcoacfa to linking fimdiiig and 
performance achieves its desired results. 

The use of perfomaance standards in the Job Training 
Partnership Act (JTPA) provides periiaps the most extensive 
body of experience with pe rfo r ma nce-baaed funding Hie 
JTPA expmmct is particularly in i ere ai tn g becsnae the 
population aerved is largely die same aerved by adult basic 
education pro gram s^ The 10-year e3q>erience has lecendy been 
carefoUy md critically reviewed.^^ 

California's inq)lementation of the GAIN program has 
initiated a wel&ie refonn effort widi perfcmnance-telated 
funding of client services.^^ 



y u : t^x . ^ ^ti iriwmn in "iHiiMiri iiwiing** mutirt Hiiminn rith iii rn—nwdrilinn nf 

HwittrioiM of concept of tiw — riw ><fac«rioml mkmtm. At iIm tM lino mny coaMng odiKoiM ojmw^ 
faiiif. S— w> Strmt wm wvohrtioBkii mm ■■liiliunil wrfm^idii^ oT owly cliOdhood •A^tfAim. 

1^ JI7A AdvMory CooMiL ir#9«% Ci|»a^^ 

l^Nailo«dCKn«fBQn*AiMdMioiv"Wolfm 1919. AadMooftl mfbinMioo wiU bo avaiteb^ 

(fbrtheonufig. Ayvil 1990) 
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Models and Proposab 



The strategy for 
linking funding to 
performance must 
be scrutinized with 
great care in order 
to avoid 
disincentives to 
quality service and 
to allow service 
providers to 
optimize the 
service flexibility. 



This section leviews five existing ftmding iimovstioiis 
pcftineot to edolt educerton? 

• nTAperfotmiDoeitap dards 

• Welfiie lefocin pecfiwDSDoe*besed fonding 

• Pcivaie sector peffipniwttoe«bisedfiiiidiiig 

• Vafaie-addedftaiidiiigiahi||)erediicatim 

• Califimiisdistaiice teaming courses 

This bise of cqieiience configns the feuiMlity (rf linking 
funding to perfoonsnce end oigsntmiooil efficiency. 
However, the stmegy fof ftmdmg to peifonninoe must 
be scrutinized with great care in older to avoid disiiiceiaiyei to 
quality service and to allow service p roviders lo e ptin i ge tfie 
service flexibility. Key dements in nuddng perfbmiSDoe-based 
funding foster innovation indnde the careAd dioice <rf 
performance measures and providing organizsdoos adecjuaie 
flexMity to eqriore a wide range of spproadies to achieving 
the desired objectives.^ 

JTPA EXPERIENCE IN LINKING 
FUNDING TO PERFORMANCE 



As a resuk of growing public concern about the 
accountability of the federal enployment training system under 
the Comprehensive Emplcymem and Training Act (CETA)« its 
rq)lacement, the Job Training Partnermip Aa (JTPA) 
mandated that die DroMtoem of Utoor estaM^ 
standards for Service Delivery Areas (SDA's). 

JTPA perfbtmance standaids require that SDA*s achieve 
performance bendimarks in <mler to be funded, but do not 1^ 
levd of funding to performance (statutorily, die fimding is 
based on a formula). The perfcmnance bencfamaiks are 
''floating*" in diat they tie perfomiance requirements to 
national norms and local. Thus, SDA*s must meet minimum 
standards. However, there are rewards for ex^'eeding die 
minimum standards. 



to clarify liwr mi Mi on . to btvwycipttckmdAi^ 
informaiioA tyiim prcpoMd n policy opiM» 3, ^ 

ftctivtiioi which allow omovaitvc aarvioa dalmiy in an Miviranniant where fwMng ia Knkod lo perf< 



for nonpro f it i 
ma. Than 

aalf-ovalMtion 
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csttbUriiBic d 

CUUUlBfVlfliB( 




By linking 
performance to 
output measures 
only, JTPA created 
strong pressures 
toward 
"creaming" 
providing 
preferential 
service to the 
clients most likely 
to succeed. 



The tfpntdk takn Depmneot of Labor in 

mIdHs the 

employmeat me, U) the mnfe 
(3) the nanber o f wtUm c 
These outco m e meMoni ve 
coft-efifecti^rflMss, "coit per eoHrad inployme^ 

UnfaftiBMdy, there nay be t "(kmrnide** to 
By Un ki i ^ p erfomMPce to omput meaaMW on^, J TPA cw aia B 
strong preesasee towaid "creaming,'* providow piefcrewi ia l 
service to the dknts moat likely to mcoeed. TooOatdila 
tendncy. the p e rf or man c e atandanb incliMled a laage aat of 
nocd adjoatmem fMm** teined to acooont for the vaM 
in overaU peifomince cn«ed by local economic ooodihOBi 
aiidthepaitk»lar'^*'ofcUanttaerved(iDpat£Mm thns, 
areas that had greater pmp or ti on a of "hard-to-eerve" cUems 
were aUe to justify lower peiiuiiiiance omcociea. 

Variations in local oonditiaas, inchiding both e c o n o m ic 
ccmditians and client mix, accooored for abmit 35-40 paroanc 
of overall SDA perfbrmanoe. This snggeata that while local 
conditions significanrty affected perfoanance, odiar fiKtora 
(presumably quality of the program interventiooand 
effectiveness <rf service delivery) were i aapor tmt m e dkie r a of 
outcomes.^ However, one yety iia a ca t iiit fincMg from tbt 
eaiiiest perftnmance moddin|; efforts waa diat e d acatk i wri 
attainment was as good a predictor of o i tfcomea as w ere y , 
race, and sex, (e.g. educational status was one of die primary 
deteiminants of enqdoyability). 

The problem faced by the Department of Labor in 
estaUi^ung a perfonnance-linked system was one of 
meanirabil^. The employmem training intervention was 
designed to a£fect a variable diat is extremely difScdt to 
define— "employability.'* While die measures of die "value" 
of die program intervention. Entered Emfdoymem Rate (EER) 
, and WAGE (postprogram wage i«e), were solid, tangible 
outoxnes, diere was no stdsfiactoiy measure of client 
"enqiloyability'*pn(»toimgrampaiticq>ati(». Consequendy, 
die performance standards were likely to similarly reward bodi 
quality interventions and stnttegies that screened out die 
hardest to serve ("creaming")-" 

Many analysts also questioned the validity of die "ottered 
eiiq>loynient" measure because die problem faced by JTPA 
clients was not an inability to be employed, but an inability to 
secure stable jobs widi career ladders. Consequendy, the 



13 Title n-B/C FY 19(3 PcffcnnMce Sundvdi «id MbmuMce Modelmi Vmmt," VS. Dip«iiMiit Ubor (no dm). 

"WhiWlheperfo»inMc«it«Kl»r«k«d^forcliM«mixMthMir«pmii^ 
tir««|y of Ki^taf o* tat ll» mow tBMloyAte ■BOiii *e -Wio 
nioeets. detpiw ths adiiumMnl fceton iaiMidid to rah it a«L 
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hwas not clear 
whether 
the desired 
outcomes — 
employment 
and increased 
earnings- 
stemmed from the 
program 
intervention 
or from other 
unrelated feictors. 



**eniend caaplQyEBeBf meaiareof perfoanmce wnfetttobe 
a nlMed, bvt nto poor mbmum, of tte actaat imM 
OUU.WID maskjiUikf (indndiBf pamunency of oeapiey. 
matt toA CMoer a dv i acemmit m po tiuolito t). 

Aaocber leiioat piobtem waa ifatt ilie meaame of **cott- 
e ffecti v toBa a ." tfie '*coai pat —wed anptoynMBt" cwaad yy 
strong ia cw d v aa to dacmaa ite lavd of mvke iuwvemioo. 
Ill fKt, ai plioMd, amia ooac of acfvke inncvaaliflB Mdar 
JTPA M aifirificiwrty. Howm. it was not doar Urn ihia 
measoie of sneceas ioaeased program cf fe cii vans a a or 
decreased profrsm (joality. HnaUy, there also wew conoonw 
thst iiieasaiomeat of pngiam anooaas in tanns of aoytoyaMot 
reflected the labor inaiiDet oondiiiaiia of locd SDA'a fate te 
the qnality of service. For exanople, a SDA locaied witUn a 
thri^mig local economy mii^ have high socceas naea 
refpuxfless of die qiudity of service 

Ultimstdy, the problem fKing the De pa itment of Labor in 
relation to its use of perfoimance stsndards waa one endemic to 
all program evaluation. WidKMit control gnrapa, it was not 
dear whether the desired ootcoro es em ployment and 
increased earnings— stemmed from die program intervention 
or from odwr unrdated fiKtors." 

Almost a decade (1982-1989) of experience widi TTFA 
performance standards has diown that stiuctuzal problems 
widi linking performance and ftmding inadvenendy omatod 
disincentives to qnality. However, die linkage betwaan 
performance and fonding was soccessftd in some aopectt. Por 
example, fostering innovative coUaborations beMoan ibt 
public and pdvMe aector and diversifying die ^pproadwa uaed 
to deliver services have bodi proven successful 

The recent report of die JTPA Advisory Commitiee 
straightfrawanlly addresses many of die inadequacies of the 
"first-generation" perfonnance incentives and reconanends 
several revisions in the JTPA performance standards. The full 
set of recommendations provide a co m p rdi enaive and well- 
articuhoed emfdoymem training reform package. The moat 
rdevant development for performance-linked funding is die 
recommendation to create a new overall performance measure 
for JTPA based on state or national basic skills competency 
measures.** At die same time, die job jdaoement measure is 
retained bm enriched by increasing emi^asis <m job retention. 
Related recommendations focus on the managemem 
information system requirements, dearly defined data dements 



1^ "fttrnmimmlMinni <rf dw Job Travinf Leumlnrilnil Swvey RMMrch A&imury Pner Offie* of SinH|ie PhMiiini md Policy 
DevdopmMl. ETA. VJS. DtfMMM oTLiSer, NovMBbw. IMS. 



1* Thk Ni|M dM Cdifomta win lodiM MMMie adviMafM by novng 
con^MMiciMtenislKboMilMifariialioMladoiHieabydwriP At in olhwMMi. « 



of dN tte Akio MIS MMdHd iiaVfom cempMiiivMw in 
Tlw tkm pm of n?A ■Mh«riaii«a mdM it aMM Uwly dwt dM DnMMM of La^ 
speeifK bMic lUnt coovMmy MndMdi uia FY "91 M dw MriiM W moR probAly, FY '92. 
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and common croM-pcognm dam etemeois, tfatf moat be 

The iu4 ) u i uu> c< of the JTPA AMocy CowmiHto npoa 
lies not oidy ia the £n ite it wm pfovide tte btiic nraoBM 
for fntme empl^jnaM ttaiBiBi policy at iie iidKd 1^ 
also its leMBdon of a o a if oBiwa c o^ialPid ftadtof magy 
M^iid) has been modifieo to umc o iut some of die proUems 
implicit in die fiist iMsratian of die eystem. 

Hie oboeived dnwbtcks to die JTPA pecfi»maooe synem 
have sevend inpUcarions idevant to Cdifoinia's deai|it of 
pexfbnnaDCe-linked iuuwatife ftmding a pp roach e s . Hie 
fdlowing are of pdmaiy concern to ns here: 

• TTPA idied on an jnadegpatt measme of 
p erfbniMBic e . Becanaejobpl acemfnt jwie was 
not well oooelated wim long -wm enanloymeot 
stability or career advancement, iIm peffiMDBBnioe 
standards lowered service qiiility.>' The 
onteome measure used in p e rfo n B tncfr4inlBBd 
fim^ should measure die desired piopam 
outcome reUably. If it is infieasible to measme 
the desired outcome reliably, die omoome 
measure used to gauge and reward perfoimance 
must be reliably conelated with die destied 
outcome. 

• JTPA's complicated system of local adjostmett 
factors did not successfidly co m pei wa w for the 
lack of a system to direcdy measure individnal 
employabillty at intake." A funding atiategy 
wmch links pei fo nn a nce tc o mc o mes oiuy 
should not be as hij^ Ihvored as one diat Imks 
fimdhig to die value-added by die program 
interventioiL 

• The DqMitmem of Labor maintainrid con^dex, 
process-oriented measures of granlee compliance 
diat served to weakoi die duust townd a 
peifonnance-based system. Pecfoimance4iidced 
funding should sUow programs die operadonal 
flexibility to test innovadve service deliveiy 
i^pproadies. When perfomianoe4ndced funding 
is mixe^ with process-oriented program 



ERIC 



17 The dif(k«lty wMi job pl«6MnM« M « pofoimaM nMMm 
perfectly c«mlML la eeiiBiftcaatMWHbirof cieeeii»ywo<a¥Wwly itUiid> 

lobe. While the poet^goyMi wage m mmmn mrmi •» i mm w t tfw c&imk6m h m rntm wylnywH md Ae deriwd wH c on 
(amptoyebtti^), il did not €«ry eleqaaie 

<keifebtKty of welgfctjag ae rfei a i e Bc a U Ma ni If nihiale Miae ai ei eia aead. 



l^Vocationeiffehabiiilalka pgeyiMM wrflitad fto« pfobleBM ebailef la ITTA ia i 
liicenwi, wMwat m edey en mmm^ of haw W 
1 by ihe davalapaeal of a aaeUy aeed ci 
'Tliie iaetnwaeat> ihe P i B c t to n el Aeeweawall a vea t o i y, k ea'exoaHgK 



pnneriiyoaoaieoiMe,wilhaatMadeqaeiiaMaM«ofhawndtf^ Oae paeeMe eahitiaa 

wee u ieiiatii by the il ei>g l e |i we a< af a aaeUy aeed chackBet that i ppeeied ta have t 



global awribaie(aiiylc y ^bi H ty)Mriwhkhkabaaaailyaeed^a ^ Sae. Fanctioaal Aeegii mml hvatnary Hmmd, Steal 

VocMwoel RehebihtatM laettote* Univeieity of Wiaeooaa, 1914. 
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w81 dfluic tilt effect of the 



n?A . 

idoi|ucy indy 




did not ffwaid 
only to iniiiw 

fof TCWiidhK 
bittif theyhtveft 

10 cowrinpct to 
iwt tinply to 

gmnDBec • iTtiiuiTwin pot lu t m i n ce or 
pciftiiiimco **floor.*' 

• XIPA "^pcffomunce itandiids*' designed to 
inooaee coet-e£fipctiveiieei were not true 
pedbmunoe newiiiet wl seirved prinitfuly to 
oecreeee coic wunoui ipciwiiuip oneoDvenen. 
ConiWnim peffouuenoe wcMtxftu with coR* 
contrd inceQCives pfovidee a mixod meeeeffe to 
eervioe deliveiy onpuzMioitt 
as wdl as a sunpler set of p egfa man ce 
incentives diat provide fimdiog direcdy rdsied 
to "Value** of the interventioa. 

All in all, peffonnanoe baaed fdnding systems sppUed by 
JTPA documented the Hct diat outcome-related fonding 
impscts how p rogr ams fimction and ondencoiea the need to 
carefully design perfcmnance measures to reflect desired 

outcomes. 



WELFARE REFORM EXPERIENCE 



Efifoits to develop commdiensive strategies to move 
welfare recq>ients from AFDC into employment have focused 
a great dMl of attention on die measurement of educatiottal 
conqietendes among disadvantaged groiqis. Califomia's 
GAIN legisladon, because it was die earnest and die lacgeat of 
die compiehensive wel£ne-to-woik efforts, provides an 
imp o rtant base of eoqienence for designing the Unk between 
pecfonusnce and funding* The program represents die largest 
eaqieriment with program-wide measurement of educatimal 
co mp e te ncies at iittake* 

The GAIN esqierience provides a good exanqde of die 
desirability of measuring die value of an educational 
i nt er v e n t i cm direcdy in terms of outcomes because the GAIN 
appraisal data reveal that input measures (years of education) 
correlate in^eifecdy with actual conqietencies. Fifteen 
percent of high school graduates enrolled in GAIN had not 
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•diievid lAoot" lea&ig co mptwncies «id 55 pemtt 
hid noi tcfaieved tchooi iiMBh oon^MNHickit.^ 

The GAIN promm awmuMii the ptogri wilmirt eda^ 

tMu Dane mis* ISipKMKt wVD ClWfJPfVlffliinV MmU 

SUUs Assessmint Symm (CASAS) iMcHnf ladiMtaaiiet 
cofufNMcscy MMnMflf toots piovidos sn mimpte of Ao mr 
01 pcnoi miiKff in o is uio mISI csd DC nie dmis zot pnoinisnos* 



liiikod ftmdint* 

This imp o ftsnt o^wdeace is yielding veqr usoAiI 
assessoMnt sod procodonl infomuttioii* This cocporisDOO sbo 
raises mny new issues: 

• How wdl do dbe CASAS msasnres of bask 
dolls cfflrnpfft'mcifis ooudaic wsdi ^he **riii^i'* 
spoctxiuQ of ddliti adult odocaaMMi pcotgjMsiis 
servo to fosKCt inchidim pioblflahaolviQg 
ability, coinimiiiicaiion ddlls, aod 

• What is ttut individual vaiianoe in rates ot 
lesming as measui ed by the CASAS sppndaai 
system? Ifdieieisliislivahanoe,isdieiranai»e 
random, os do pattena cmetge tfiat mi^tt appear 
to require adjustments for specific groups of 
*%snl*to-sefve** learners in oider to insme a fur 
and nentral link between fimding and 
peifiocmmce? 

• Is learning as measoied by Ae CASAS sppcaiaal 
system linMtr acHMS die foU raiig^ 
competencies? If it is not linear, how mndi do 
learning rates vary and how mig^ a 
perfinmDKe-fonding litik saccessfolty its 
fomiala to begmnsig, mtemiediate, and 
advanced learners? 

• To what extent sie learning gains on die CASAS 
an artifKt of retesting? What pfotocols can 
minimirr test-retest effects (e.;. by setting 
minimum time intervals f(»rpreA>ost tests)? 

A recent rqxm suggests diat in at least one area of basic 
skills competency, Engflish Isnguage ability, learning is not 
linear. The tttxpt of die learning curve was different for the 
two specific skills (reading and listening) diat were tested.^ 




*Third Report OAiN Appnital ProffMii," CASAS, Fifww 16 «id 

•^EvaliMtuf Slwteiit ProfrMt «d Sttdtot OoiU AttauMmiM for 321 pMikd A|enciet,** CASAS, Seplnnber. 1999. 
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The Nirioiiil Oovemoii' Anc^eiatioa (NQA) s ipiifMiriBg t 

pranm* iy.iiBdiBt ^^bwt cam mi d to . The NOA flo^ 
ukHchm that mat m lamt ^ virie^ of mmmot of btik 
sidUi g wy et en c i ct, Ite CaSAs riiodd be inMiiiifirt 
cmftilly in ciotB|wriioo to oditf nmmret of cidiiCMtoflil 
perfonnnMe in devdopnif bnfe ddUs. 



In fcneiil, tbe wdfitte-«HPvoik pcogimt witt provide 
i t np oft ii nt empirictl i i i lP Tfinft^^rtiHP on bisic tcfsisitiQn. 
Thi?isbecwMviitiuriyiAcl!b^ ia coipor t te fluriy wteniiye 
nm^gement jofouuMim syttemt (MIS) Ait provide die biStt 
for iniwering sone of too tednf cd (joestioos relMing to the 
pcf forinince^fiinding link. 



VALUE-ADDED 
POSTSECOIWARY MODELS 



A number of 
states have taken 
concrete steps to 
tie institutional 
accountability to 
student assessment 
by mandating 
assessment 
programs that 
measure student 
achievement and 
place students in 
entry level English 
and math courses. 



The growing cost of hi^ier edocatioti and otiier p re aemes 
on public colleges and omvenities have incieaaed demands 
that diey be more accountable for their services. A flnmber of 
states have taken concrete steps to tie insrimtional 
accountability to student a ss e sa i nmt by mandating aaseaament 
p ro g ram s that measure student achisvement and fdace students 
in entry level En^idi and madi courses.^ 

States and institutions considering sudi ifjproadies must 
deiennine how institutional contrflwtions to sb&m kn^ 
should be measured and what student outcomes should be 
assessed^ An American Council <tf Education survey 
indicated diat three-fourtfis of due nation's colleges ejqpect to 
introduce some fcmn of student assessment wUun the next 
several yean.^ Twenty fivn pment of die reporting 
institutions reported that dieir states (1987) required 
assessments of student perfinnanoe. Education Commission 
of die States* data indicated that about one-tiiird of die states 
have some form of statewide assessment, assessment indiich 
frequently is required by state law or regulation.^ 

In 1987 the California Postsecondary Education 
Commissim (CPEC) reviewed the means of funding 
excellence in postseccmdary educatim. This study was aide to 



TIm ivMMch for tiM MbMclaoa » itei iron Jo^ 
Mtf /jMilMlMif im Bifktr BAmmUm, ■ rapoct to fbt Natmiil EdMcatiott 

Edvcaitoa. WaiUttttoa D.Ch 19M. 
^ RiMtffcb Mid advlMfy MlMiM 

liMtitvie for MMfch and PliOMBf, 

23i 
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7 (Qorii^ StiBdMdt and Pwfamico M om ii oo) of the 
UN MM. SooIM Book, Job Ebo«iB|.Mwk«Stiocklty.M^ 

aiUbniii, Kby. 1990. 

Ainwk«ComdiooBdMition,CM«M»r#«odli/m^ i9r7. cHodin Indii Mdl^irtir. dtf/M/Mpoge 1 



Bdocnion ComwiMion of the Smw. M mmmt mt m mi Omkmm M^mtmwmm: A Vigw Fmm At S$atn. Donvor. Colofido. 



March. 1917. ciiad in kMiU and Porter. «i m., ibid, page 3. 
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lediKe the numarom Mologies of coUe';e outconaes to dune 
common denomintOCT:* 

• Studem knowk^i-Hhe stodem's lecogDitioo 
Stndem' iiipiied ddOi-ltieir abil^ to agty 



the luMywledft tbty ponen. lane 
addreii ite beik jnattecmal ftnoiloas Uke 
readily oogaiAft ddBt lach at iliiBking and 
developii^ an j uOty mi i kn line of iaqOif, ml 
kujirfedfe baiUii« 4dDi. iDch as tiwae raq^ 
to make senae of a mt or body of knovrtadie. 



• Stodems' afaOiiiea and valnea tfaair ability to 
toleme anibigaiQr or divenity of opinMn and to 
judge an a t gum a at on dw basis oi in merits 
ratber dunthe aomce. 

A study by Berausn, Weiler Associai M sugg e attfljai wh ile 
dwce may be some cona e nsua on iiiii>iiniun d a finitinns <tf 
quality, diete is litde agreement on die nUmioadbip between 
pexfoimance on a test and lAnlity to auoceed m d»e red 
world. Dififetem qjptoacfaes nsed in diree stales are ide n ti fi ed 
as follows. 

Florida: Quality Control Approach 

The Florida postsecondaiy moach to ed ucat io n a l 
achievement b^an in the early 1980V It uaea a u crfoo na iic e - 
based qipfoach that requires stodeus to paaa me " C o P ai a 
level Academic Skills Test** (CLAST) to receive an Asaodaie 
of Arts (AA) degree or be accepted as .juniocs in four year 

ties. The 



puUic colleges and universities. The CLAST is co mpri se d of 
four wbtests in conqmtation, reading, writing and an essay. 
Students who initially ful die OAST can take q> to 35 credit 
hours in dw vppa division before having to pass it. 

The CLAST inidally was used as a pass-fail test, but die 
law was amended to permit smdents to take die test indienevar 
they wish, and as often as necessary in order to qualify for 
upper divisKMi paUic educaticm. CLAST was not dengnd as t 
predictor of upper division success, but as an indicttion that 
students have die basic cra^encies needed for success in 
college. 

The implementation of the 1989 CLAST standard has 
proven controversial because fewer Black and Latino students 
were able to pass it in its design stage. 



lUport $7-18. ciiDd in iMiU and Poilor. <f al^ /W. page 10. 
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Missouri has 
required its four 
year colleges and 
universities to 
develop a program 
to evaluate their 
general curricula 
as part of an 
examination of 
their mission and 
goals. 



Missouri: Multiple Measures of 
InstHtttkHua Quality 

Miitoari hat raqoiml iit fow yov ooUofM^^ 
to develop a pfognm 
of an CTiiiiinatiop of 
is expoctwl to MB umMipta 
(1) tmveys of amdear 
collection of data on 
activities. 



aad|oals. 

and enployefa, (2) tine 
and (3) analyais of 



Missouri, like Florida, hu had eaity . 
postae co i kla iy student aw eaw iMnt However, k 
SntionTNoAliweat Misaoori State Univenity OOdcavW* 
diat ini^ted a pvognan in die mid 1970*8. Tbeir Midett 
s ss e sa ment piogfftn has hid tfaiee co mp o n e n ts; 

• A vahie-added coi iH Wiiwi t based on the ACT and 
ACT Golkfe Ontcomea MeasBies Progtaoi 
(COMP) to measue stndeBt ffowdi in general 
knowledge daring die fiist two jrears of collesB- 



A "comparative ad ii evement" compooeot to 
demonstrate student achievement in the muor 
field of study by means of a test adminiatend at 
the end of the senior year and required for 
graduation. 



• An "attitudinal'' comp one nt designed to 
student perceptions of their own development, 
the univenity, sod university services vis 
surveys administered at different points in the 
studem's education. 

The strengdis of diis pro gram are its conqndiensiveness, 
strai^itforwardness, and eaae of use. It has been given high 
maiksfor. 

• Using assessment inf omution as a tool to refine 
die university's mission. 

• Miking the infbanati<m readily available and by 
providmg leadershq) to die President and senior 

j ^fapiniiy tr to r s . 

• Cieating conditims where information is used to 
encourage in^rovements, not punish poor 
ichievement. 

• Encouraging and obtaining fuility involvement 
in program anilysis ind development. 

More recent efforts have focused on refining die 
university's mission and goals widiin the state university 
system. 



ERIC 



37 



ADVISORY REVIEW DRAFT - July 23, 1990 



A20P2CH2 



Ftutding for Iitnayatum md Ftrformance (Chapitr 2) 



Tennessee: Vtlue-Added ApproM^ 



Tennessee uses 
a peifarmMtce- 
basedfiotding 
approach that 
originated within 
its State 
Department of 
Education, but was 
later legislated. 



originMod wite its Sm DMMM «f BdB^^ 
iMrkfiilMed. TlNirqipnM&pnvidodvi^iofivepMlor 
an iuSndM't annl Mfst &r ioMraciioo rnqr t» twaritd 
oo the btii« of in ifcitty to dwimlMM 
five perfcxnunce mmi wMiia the ^ 
cunicvJnui, fflnlfmf <UimlM wA o pin to M , •nd 
adiievemem k major fleUi. 

Hie 1984 criteria to determine pexfocmanoe faadiog 
eligib^i^ were: 

• The Mopoi ti on d p io giami eligible fat 
accxeditinf tfatt are accxedited; 

• IliepropoitioD of profCHBidiit inititted apeer 
and oooftdUBBtive renew; and especially for 
pognma dm dUao^dwae ttwt demonatnae 
unproved atudent pecfoonaDce; 

• Ihe demooamtion diat the fonenl e d n cari on 
c onapooea t . oaing die ACT-OOMP exam, and 
demu u atia ti OD dMt die p erfar ma nc e of aanioa 
exceeda die mean of die vafaie-idded ooopMed 
f or aenion at a groiq> of compenAjle insdtmiona; 



• Hie demonatiarioo diat aoiveya of awwanw. 
alumni, commimity memben, and/or enpioyen 
have served as die baais for apedal 
improvements in campua programs; and 

• Inytenwitiriop of t cnoput-wide jUm for 
instructional impfovement based on items 1*^ 
above.^ 

The fdnding formula uses the base instructional allocation 
to the institutioiL It tfien ^ifAies oo top of it some portion or 
allof ttiefivepcfceaofthealtocation. This is detenninod ^ y 
the extent diat Mdi of die state criterion was met Ihecrio. * 
are given different wei^its widi criteria four and five 
accounting for only 10 percent eadi; criteria one and three 
25 percent eadi, and criterion 2 rated at slighdy higher dian 
30 percent. 

Costs of testing were estimated to be about $15 per student 
and were largely borne by the State I>q>artment of Education. 
Integration of ^ data into coUege and university planning has 
varied by institution. 



<b# Am mmtu i tfO m tm a , paper fn mnm 6 to the Amwkn Bdiication Rmsith AMociatjon, April 24. 19S< and ctM k liMli and 
PoMr. /M. p«iM 2S-29. 
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FageTS 



Hiis 

me umfomcj 
•dviting. It 
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iLmewiy 



wqpcBEricali 

OK WCMIWy 

ID Kuiif HKi nion 



tin 



piMMW far 



California State University, Chico: 
Distance Learning Approacli 



Disttnce tooning, tbe provisk» of live or recofded ont 
wi^ or imaactive mumctkm''. » one mediiiin cf kmm Ji iu a 
tnti msy dcqooi nopi iCMnBiirwiiKfn nwnooi omor wktok 
of tbe ADA. Califeaiift Slate Univenity, Chko has a 
distmgiiidied locoid of prandaig tdecoitnes and video 
tdeconfciencing. 

For tbe moit part dieee coones, inctading special degiee 
courses offend for selected tedmology films, are developed on 
a foe-for*service basis. This lequiies the Uuiveuitjr to eninste 

(1) costs or toe course oeveiopmeiii ana possenanoQ, 

(2) fixed t^riifniiftiim co8ts« (3) the number of peis e ns who 
will take tbe course and (4) what price they are wflUiK le psgr 
for die course. AcoofdiogtoRal^MQeter, Dean<rfKe|im 
and Contmning Edocationt tfiis ofken places tbe lAuveisicy at 
risk of not bekig able to recover its costs. At die lean, lUs 
reimbursement qsproadi makes it di£Bcult to bufld m the foed 
overhead costs associated with diis bi^ tedi i nstrt K tional 
dppto$ch* 



Dean Mooter favors a fonding ipprnwch for 
learning diat includes a fixed base rate that cm be rationally 
calculated and then a variaUe rste of reimbmsement based on 
persons taking the tdecourses. 



23 



Summary 



Review of usefol models and prq)Osals indicates that 
performance measures can be used unrformly, faiiiy or 
neutrally, and performance can correlate well with dc^nred 
outcomes. Unfortunately, there does mpear to be an existing 
model diat seems entirely iqrpropriate for adult and noncredit 
education. 



However, diere are elements and experience from the 
several models examined that provide useful guides. They are: 



^'^ Interactive rafen to the ability for leanrni to reapoiid to iBttniction by aaluog or answcrii^ qtMSttooa. 
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• meMoies most take imo •ocount 
die diffoini tevcli of leamen. 

• r iifuimMiLii imm ii ii i imiilil aililrrn iir irilur 
added by ibe ioHratkiiL 

• Perfbmiance ineaiuica riiould be baaed on life 
skflUcompeiencieK. 

• Only one modd (T ennea ee e ) aeeks to reward 
qaaUty petfomMuoe fer acfakving attodaids. 

• Anodier model (Nfiaaonri) (kii M a iw ia iM die 
feaaftiliiy of d eve l o ping ''ndr meaanrea of 
quality edncKioaal OQioomea. 

• Liiddiig ftadii^ to peffoanance will reqoire 
developmntal elfdm to oafk a syaiem tailoied 
to die qiec^ needa of adob edncatioa. 

• CanM teating of petfbanance-Ofieatod fnadi^ 
incentives will be needed to dcinnnine exacdy 
how dieoietically aticactive syaMoas actually 
change educational pnifidea' bdiavior, and. 

• Linking fimding to peifemunice will requite 
developmental efiints to craft a s^nm tailoied 
to die specific needs of adolt educttioa. 

• Effective linkage of fiinding to pecfimnance 
requires that program s be given dw marimmn 
possible flexMxty to meet perfonnaoce 
objectives. 

The next section discusses other developments diat mnal be 
considered in drsigning finding systems diat enooaaie 
innovation and qu^ity peifcmiuuioe. In paiticidar, the 
examination covers die growing importance of tedmology in 
perooitdng instniction to be more peraonaUzed and fiexflde, 
and social trmds Aat will shape adult education needs and 
services over the next decade. 



2.4 New Developments and Considerations 



Many influential trends bear direcdy oa the issue of 
funding for innovation and performance, and must be 
considered carefully in deiiberatira regarding policy options 
for funding innovation. These trends indude: 

(1) Learning Technologies. The introduction of 
new learning technologies has and will continue 
to change die fundamental nature of structured 
adult learning. 
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(2) Worfcptaoe and Carter Change Require- 
nmtt> The r hanging wort'pltse noisea tbtt 
wodcen in vinnlfy dl oocopadoos have new 
typecofnmic''*iIls. A^mauOf. l a umn m 

mobOiiy raqpikev^^ ^vockm aoqt^ new 
cipibjlitiettoiMmc^pM^l^^ 

(3) Population Trrads and Immigration. 
Immifncion of fofoign*bom woiiDCfs with 
limited Engliah ability and litency and litde 
ediica-tional experience creates hijfix levds of 
demand fiMT new edncadon services for adolis. 

(4) School Dropout Rates. Continomg hifgtx rstes 
of jonkv md hi|^ sdxxd drojpout leqete 
maintenance of ^'remedial** education services. 



These trends relate to tlie outcomes of adult education, die 
demands made by society of its educational institutions. But 
they also relate to die process of education, how educational 
institutions go about meeting demands now and in the near 
future. In the following section, the implications d each of 
these trends for poli^ dedsions r^arding funding for 
innovation and perfonnance are reviewed. 



NEW TECHNOLOGIES 



Two waves of 
technology are 
affecting our views 
of education and 
the delivery of 
adult education 
services. 



Two waves of technology are affecting our views of 
educati<m and the delivery of adult educaticm services. The 
first technology, television, led to the developmem of ^'distance 
learning.** Tfa^ second, computer tedmology, has led to die 
development of ^'conqiuter managed instraction" and 
^'computer assisted instruction.** 

In some respects, these technological developments are two 
separate waves of rq>id technological change. In odier 
respects, they overlap. 



Distance Learning 



The development of ''distance learning" in the 1970*s 
catalyzed a fundamental reevaluation of the nature of learning. 
''Distance learning" activities include broadcast and satellite 
television, and Instructional Television Fixed Service (ITFS) 
delivered narrowcasts* 

The earliest experiments with both adult and K-12 learners 
revealed that effective learning must be much more interactive 
than had been appreciated eariier. The student confronted with 
a "instmctor" 20 miles or 3,000 miles away did not learn as 
well as those in the classroom. This was true evai with "return 
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Technology, by 
inadvertently 
separating transfer 
ofirrformation 
from personal 
interaction, 
focused attention 
on the importance 
of the learning 
context, of active 
learning, and of 
the need to create 
supportive 
learning 

environments for 
distant learners. 



audio'* thai allowod diMnt students to uk question of 
nistnictoiis*^ 

Technology, by ini dvenen t^ sepsrsring triMfcr of 
iiifommioii from peraonsi inteiactioiit fo cus e d s tu i ifi o ii on the 
unpoMiioe of die laemint oeiiieoa, ^ 
dieiieedtocieeiesmoitiyoleem^ 
Icamets. ConseqncBtty, tetocomsee (• tern unheeid of heiais 
the 197(rs) befsn to lety on ^'iotmntod cufiicohBD yck s ys^ 
ss a means of p rov idmg tomer sn^spofi setvic^ Gmeadbf » 
die staodsid teleoouise ptdcege mdudes fnfptM tm^^ t 
companion texdwok, and a vanety of insmidor (or group 
leader) fichnical a s sis rs ncr msnuds. In many caaeSt dM 
integr«ed corricuhwn design was designed s pe cific al ly to 
support ^'teaching'* efforts by n onprof r ision als.^ 

This educational strata was siqspofted heavily by die 
US. Department of Education and the Corporation for Public 
Broadcasdng. It led, for example, to telecocraes focusiiig on 
sex role stereotyping, mental heatah, and career awareness. 
Because the use of tdevision allowed die pi ea ertation of 
highly stnictured dramatic scenarios, it becwoe dear that the 
purpose of die ''educatknal in t e r venti on*' was not only to 
cmvey knowledge but to change people's life skills in globd, 
but well defined, ways. 

The marriage of educatkm and mass media to create the 
phen<mienon of ""distance learning** via telecouiaes also 
brought widi it the technology (and concerns) of audience 
measurement. From die beginning, demogrqphics were an 
important part of audience measurements (rg.tlie 
measurement of success in readiing qiedfic, standardised 
target audiences). In die 1980*s program design and 
measurement amcems were expanded to include the concepts 
of ""audience segments** as a richer description of 
demognqphics, and fimiudly defined measures of programs* 
psychological impacts on audiences via ""quality ratings.**^ 

The availability of television for ""distance learning** has 
revolutionized the cmcept of learning, particularly adult 
learning. Several realizations acomipany this revolutim. 
Learning occurs in a wide range of informal social contexts. 



^ Thare is an Mitmive liMM on ttw iriiif x p wii mtm in utolliM-delivieftd ad>lt •d»c«iioa, at many ct the cffom ware 
federally fand»d "acoon waawch** prpidcti. Adult tdMcation proiacto cowkiacl primarily of continiif aAiction for fnimnontk in 
remote areas. Tim warn alaooffom lo improve dMqaalky of lUUodiieolm There waa not, to o«r knowladte, any 

cfToft to aaa amaUiie-dalivMd miirial for ad«lt odo ct kn. 

^ One exampk of Ihk aert of cmcnlm pociu|a k ■wlvia^ 
cky yonih aboot capaaw daai§nad for "laanunf o a vko m a el a** raQf«i| Iron chnrclMa, lo comnMinity amplosriMnt ommoib, to 
cradmonalclaoerooma. Tke YES, fnc. C n i di^ioit (Km$m and Rkhardaon. Cofpomtion for PtMk Bfood ciiti nt. 1914). 

^ The SRI bamMlNnnl popnlabon topology rdbned to aa VAU 
**i|aality ratinfi** otenoMd from a nMlls.yoar. BMlli-BUUon d^^ 

partof aairiii|DftoincsMaadwqMliiyofU.S.toltvkion. Thb irapnct'^valMiiQn tMlmo^w. akhongh corre^ 
lechnicolly woU davoloBod and availoUa fernae in kammt oonlexis that are itfii|htforw a Hy odocntional, m woII aa in **karain|** 
product loyaky. Soe 'Televieion Andianoe Aaaetamant— A€aident*8 Eaaay.** Lloyd N. MMriaett The John and Mary Markk 
Fovndation AiMMal Report I965/1986. 1986/19S7. 
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In distance 
learning, the 
"value"' of the 
educational inter- 
vention is not 
related as much to 
the amount of 
exposure time but, 
rather to the 
amount of time 
and quality of 
material. 



The 'Valiie'* of edncition cannot be My captued by 

in^^T^ m minj^m timMn^iM ftf tommy Of WQglMS dOM t 

stn>dardi»d cuiiiimmm wcfa as grade level. Se vtna elMMati 
of teaming that wcie joined in face-io-ftee coi wm i n ica ti oo 
most be uldmaed aeparatdy in the coomt of diatanoe 
learning. 

The imnoediate and ineacapabte GQQseqiience of the uae 
new modes of tranamiaaion for distance teaming was the need 
for new funding appiOKfaea. In distance teaming, the ^Value 
of die iuta r v e mi op impact on die learner in 

achieving weU yecified educational goala) is not rdasedw 
mudi to the amoom of txpomn time but, radier to the amoont 
of time and quality tit mtterial. In tnm dns meant that 
substantial and new dfm^^ were |Aaced on funding ainoe the 
bulk of costs were •n:qp-from'* costs for progmi research and 
development^^ 

Distance learning also required that educational funding 
include methods to depreciate hardware investments necessary 
to use the new technology. Current use of tdecourses, while 
funded by ADA, entails i»w sorts of e9q)enditores, chi efly f or 
licensing (cost recovery for R&D), course adminittration 
(snident enrollment and tesdng), md transmission (equqxnent 
amortization and operating costs). 

Funding mechanisms for distance learning have typically 
been very different from those traditionally used for funding 
educational services. These funds generally include revemie 
from (1) traditional cost reimbursement grants to achieve 
specifically identified objectives, (2) private sector 
underwriting, and (3) licensing and/or other user fees. Ihe 
result is that providers (program developers) are requ ired to 
undergo quality review by a variety of diffiering interest 
groups. Approaches to ^'measuring*" quality include 
soi^iisticated techniques stenmiing fctm maikett research sudi 
as focus groups md survey research. Very substantial 
"quality*' bonuses are available but there is a strong insistence 
on risk management. 

As in many private sector enterprises, there is a willingness 
to accept high levels of risk but not widiout mechanisms to 
spread the risk {e.g. funding consortia) and to dbtribute 
projected revenue from program users (e.g. highly articulated 
contracts licensing a variety of rights). 



^1 Fundmi for development end production of euie-of-the-ert lelecoureet. et meetuied for example by the level of funding for 
Afinenb^ FoundMion telecoanet m higher educeikm, tie in the order of $500,000 to $ 1 .000.000 per prognun hour. 
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Computer-Based Learning 



Conqmter-btied letmini, b^faming widi Control lHt£% 
of PLATO, openrini on t 



Where 
television 
revolutionized 
thinking about the 
objectives of 
education^ 
computer-based 
learning systems 
have come to 
revolutionize 
thinking about the 
process of 
education by 
making it possible 
for learning to 
become highly 
interactive. 



initiAl devetopmntt ^ 

super minkonpiiter wyMm doling ibe 1970*8, hat way cooae 
to hive a major impact from 1^6 on, at ttie point wheie 
software and haidware for adult education become available 
off die shelf. 

Where televisioa revohmomzed diinidng abom die 
objectives of edttcaiion> computer-baaed leanuog syalems have 
come to revolutioDize ddnldng about die ptoceas of ecfci cari o n 
by makhig it poasibie for learning to become hi(^ 
interactive*^ Current compuier tedmology tttdces itpoaaMe 
for *^graromed leming** to be highly indhriduaUMd; in 
pnctice, few systems acmally make use of die full cqMbflities 
of die technology for individualizing learning (via multq^ 
brandling decision trees). 

The "first getieratira'' computer-baaed learning systems ate 
largely text-based widi varying degrees of gnphics used as a 
means of packaging the text. The ^'thhtl geocr a ti o o** 
technologies are now beginning to combine tdevision and 
microcOTaputer technology ((tigital video) in toe ractive 
computer systems that mix video, audio, text, grq)hics and 
animation into a seamless presentation of information and 
potential learning qiproaches. State-of-tbe-art S3rstems now 
can incorporate die fiill range of video effects ava ildbte in 
hi^-aid television with the conq)lex interactivity of conqmter 
programs.^ 

This new multimedia q)proach is made posdble by die 
ability to con^nress ih^ tren^nidous number of digftized video 
picture elenmits (pixels) required to make up images, and die 
emergence of new, ine3q)ensive, mass storage devices capable 
of holding the digital irdformaticm — Contact Disc Read Only 
Memory (CD-ROM). 

Both the eariy and upcoming generatims of conqmter- 
based learning systems have the cq)ability of generating 
detailed reports of learner usage and outcomes, providing 
instructors widi management iiifcmnation systems ci4>able of 
being used both to diagnose specific skills <teficits or problem 
areas and to document learning achievement. A particular 
strengdi of the learner tracking (instructional management) 
systems available is that they arc virtually all competency- 



Dernik Porter. Jo Aim Indli and Ed Kksim. Utimg EdmetHUmd Ttkm^lny ^ Oi^mm ^ AdwH Bmsk EAu^hm SMBf 
G^p: CmUf0mim't ExfeHtmets mmi Pr mp^t U , Mkro Methods, Bcriceley, Deoember 1^9. 

At thi« point, decittoni tboiit many viraal etemenu of interactive video kwning f^iieins can be m adey part of TV production 
or as part of application development, dependinf on the specific software packsfes available to specific producers. 
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based, although q)edfic coinpef e nctes can abo be ime rpfe ted 
as grade*levei acofes.^ 

The underiymg fim(&)g iaiiiea nuaed b^ 
coopMcr-baaed kamiiif ayaiema mt aonilar m aoma laqiecta 
to tiioae 01 QynDce imiiuQii* ucfaioiwani coanior vaaancii 
and development are vofy hia^ and mnai be amottiiiod by aone 
fom of aaiea oc iicenaing. UnlflDa diaianro laanuQg« compiiMf * 
baaed teammg ajfsttna an cnrnndy uaed in fbe ^aanoom, 
ahnoat ahraya m conjonctkm wA tradttiooal inatnictien, and 
ao, are mem directly tied to caqpoauiethne (aeattime)* 

In odier reapecta, die iisuea are different* Coats fbf die nae 
of coraputer-btted leumm systems vaiy printtrily m niaiioo 
to die efficiency with ^Andb the teaming ayalem ia uaed, ia 
oveifaead is fixed and opentiqgcoata are low. Also, die qpdUiy 
and costs of die highnend, coinpiiier*baaed learning syanma 
vary less than for distance leammg ayatema (wtmn there is a 
great deal of veiy low quality, low cost material availaUe)* 

Overall Implications of 
Technological Change 

The overall indications of technological change for 
funding California's aduh education system are profound. 
Technological change ims provided the tesis for a wide range 
of mo^ for learning and for efforts to match learning mode 

to individual learners* style. 

Technological change has played an inqportant part in 
broadening our concqpts of learning — what is to be learned, 
how it is to be learned, and where it is learned. 

The most direct intact of technological change is that the 
time-honored tradition of equating the *'vahie'' of an 
educaticmal interventicm vtdth dK^ amoum of seat time spent is 
no longer viable for nontraditional madune-based learning. If 
the core of learning, of educatkm, is communicatim, the ip^le 
nature of education has inexorably changed since the modes of 
communication used are becoming so radically different. 

Future changes in the next three to five years (by 1996), are 
likely to make it possible for learners to access teaming 
systems on demand ami, possibly, to ""mix and match'' the 
types of learning modes ^y want to participate in. At the 
same time, student tracking elements of computer-managed 
learning systems make it possible to measure the 'Value*' of the 



^ Recent raeeerch eag|eaa divkiiii| ibe role of the conpuier in iMirvction into tiiioe leveb: ( ! ) compyler-Mstsied leereuig, 
(2) compvter-bued lemn^ and (3) compoter rauMged inttmnkn. The third catetory indiidet nuntgement tcftwwt to track 
leaner prograat via leat koi«s and on taak'* meaattits. D. Porter. J btiH and E Kiaaanu Op, CS. 



The most direct 
impact of techno- 
logical change is 
that the time- 
honored tradition 
of equating the 
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educational 
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the amount of seat 
time spent is no 
longer viable for 
nontraditional 
machine-based 
learning. 
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edocatiooal interventkm^ least m tenns of spcaSk 
coini ietg nc ies addittwd by Ae leamiiig fymm.^ 

Nfoie indirectly, iMliii^^ 
demands has levolutiOQiaad our coooept of inHbat ed nc atio o 
does. Hie iasoe is no looger (and, acmally, mqr never have 
been) what teamen loMm^lM what tl^ Cteadyttoe 
will be move inmraction widi meie nodes for conMiMwiir i tiflft , 
and more attention paid to efibctive and noiico§nitive e iement i 
inleaminf. b is no longer possible to be ssMM witti one- 
dimensional cade-tevd measues of basic itdUs or widi 
"certifications^ bated on completion of an arfaitittily defined 
continitum of activities. 

Tedmology has piovkled Ae basis for different service 
ddivery systems, dnis posing new qoestkins ttotm how best to 
use die abilities of professional insmictors snd die energy of 
pa rapr o feasi onals. By widening edocaiocs* options, tedmology 
has laid die foundation for innovation, not just in devdopiqg 
tedmology but in mobilizing human resources. In general, 
technology impact indudes: 

• Limits of '"seat time.'^ Reimbursement for ""seat 
time'* is no lon^ reasonable for untraditional 
modes of instractkxL 

• Multiple Educational Goals. The value of 
educaticm is seen more dearly to invcrfve 
multq>le skills and to indude noncognitive 
dimensions. 

• Varied Cost Systems. The costs involved in 
education are incurred at different points in time 
and for different sorts of expoiditures dun 
before. 

Funding for innovation and peifonnance is not only 
facilitated by recent technological advances, but is also 
required in order to take advantage of new approaches to 
increase the quality and cq>adty of Ae adult education system. 

CHANGING SOCIAL 
AND ECONOMIC NEEDS 

California adult education is increasingly challenged by 
two of the most significant social and economic trends of the 
decade — a changing population and private sector demand for 
woikers with increasingly greater cq)abilities to fimcti<m in 
infonnation-rich environments. The demographic changes 
affect adult education by changing the human capital iiqrnts, 
while the workplace changes affect adult education by 
transforming the nature of the required output. 



^ i"*'!* compttter manMed imtniction tyMema that hold couneware from fmliimie ESL to QED preparation ara now available 
on CD>ROM for about $3,500 per leamai^ atation. Thctie ayttenu include gn^hki and audio elecnenu. 
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The condmitioii ^ de u Mm ip h ic ^uge nd iocfaisiiiil 
demand expcrieaoed by Critfoniia demand new types of 
"pcrfOTMOcc*' from the adult edncadon lynem and an 
increased level of innovation in older to meet die challenges 
facing leameca and emidoytfi. The fimding implicatkww are 
that new stniegies mnat obUgatonly racceed in foateriog 
imiovation (new ways of tidttcating adult learoefs) while 
fofging a link between fimdiog and peifoimance that hcMs 
service providers accountable rar (piality. The botmm line is 
providiiig workers ^9ibo are, in fact, qualified to function in the 
woriqplace of Ae 21st century. 

Industry 

demand is turning Changing Workplace 

from demanding and Role of Private Sector 

better basic skills 

to the need for new changes in the workplace are identified as akey concern in 
basic skills. California's Strategic Plan for Adult Education. The 

inq>lications of die consensus regard the need to narrow die 

skills gq> for tonx>rrow's work force. 

Most discussions of business* demand for improvements in 
basic skills taddy assume that die ddlls gq> cm be nM by 
improving die general educational levels of U^. workers or by 
increasing "litoacy."' In actuality, iruiustry demand is turning 
fxotti demanding better basic skills.^ Industry's new menu of 
skills includes the old list of 3-R's« but with a greatly increased 
emphasis on: 

• Writing skills. 

• Skill in reading material that is increasingly hig^y 
formaned and pennneated widi the technical 
language of specific occupations. 

New higher order skills in demand include problem 
solving, creative thinking, and the abiltty assume leaderdiq> 
roles. Demands for ccmimnrucation sldUs include not only the 
ability to spttk, write, and understand basic English, but also 
interperscmal skills in teamwork and negotiation. Reading, 
writing, and conqmtational skills will increasingly require use 
of appropri ate technology, such as on-line databases, and word 
processing and spreadsheet programs. 

Participation in continuing education will be more and 
more important. Virtually all workers will be expected to 



^ One of the but overviewi of mdoitry ikilb demand cm be foood in WadMm Bmiti: Tk4 SkUUEmfhym WmU, ■ 1969 
Department of Labor report pr e p ar ed by the Americi Socity for Tfaining md D e velofim en t. Our review of indnatry donand 
tncludei many aiticlea in the trade Uleranire. Parttcalariy im ef e etin a articlea arc. Jeannatte Hargrovea* 'The Basic SliUU CHata: One 
Bank Looka at in Train»| Inveatment*'. N9w EmgkmS t€0m0 m k R0wkw, October. 1919: Jack Gordon. **In Search 0r..Xifelon| 
Leamtn|^ Training. Saptea^. 1989. Bnicc Riithaiford, *The Baaic SkiUa Gap: Whoae Problem. Whoae Sofotionr Fmkik Vmu* 
F^rtm^kdy. Aagast 1989: JiM Pnce. "^ith Action and Compasaion, Manaaen Hfht DUiaracy." Smvittgg imtikmtkm. May 1 989: 
Patricia Oalagan, ** Joining Forces: Business and Education Take on Co m peti u veneaa.** TrmMtg mini Deithmtmmi j0$vn&i. July 
1988. 
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The adequacy 
with which a 
learner has 
acquired "basic 
skills'' will become 
more and difficult 
to assess because 
competency will 
really consist of 
the ability to 
respond to change 
over longer 
periods of time — 
lifelong learning, 
efficient career 
changing, and a 
variety of 
interactions with 
people and 
information. 



move through one or moie q>iiode8 of letraining as t result of 
bdoglakloCforieangDedioiiewjobt. Bwak^dOM^piOf^mM 
most eniUe tomoaaw*s adults to kim how to leant 

Wodqdace demand in the mformation ecooomyt not 
suiprisiQ^, fbcuses toon md xaott not on ^9Aim wodnfi 
know but bow tihey nttenct with odier wofken and widi 
infosmation sources, and how they commimicaae infarmathin 
Skills demand will conciaoe to vary ftom occopadon to 
ocaqwtion, but even tiiditionally low-akiD iobs in 
manuficturing, resource indoatnea^ and seivioea win reyirc 
greater ability to proceas infonnatim and oiganize wok in 
le^KXise to management conce rns . The **paswxi for 
exceUence'' called for by Tom Peters and oifaen is beiqg 
espoused passionately by a wide range of siqierviaors and 
managers. 

The impact of these dianges on funding for 
perframance vary. The adeqoa^ with which a learner has 
acquired ''basic skills'' will become more and difBcult to asaess 
because competency wiU realty consist of 
to dumge over longer periods of time — lifidong levningt 
efificiem career chmiging, and a variety of interactions widi 
people and information. 

One immediate implicaticm is diat currently availaUie 
measures of "survival skills'* are likely not to be esqianatve 
enou^ to reflect competencies required for career survival. A 
more medium-term in^dication is that our assessment of d^ 
"value" of education will need to measure a learner's 
preparedness to meet a variety of challenges rather than to 
demonstrate a dosed set of CQnq>^encies. 

The r^>idly changing nature of workplace demand makes it 
in^erative that California's adult educati<m funding strategy 
succeed in motivating adult education providers to engage in 
more risk taking. The hig|ier-order skills in thii^ing, 
communicating, and acting denuutided by industry can only be 
"taught'' (developed) by assuming risk and by increasing 
expectations.^ 

Another implication is that the process of setting 
educational objectives is likely to change. In the 19th century, 
educators took the lead in setting educational objectives and 
defining minimum expectations. As we move toward the 21st 
cenmry, the demand for "quality" learning comes not only 
£rom the public sector but from the private sector. 



^ A report inued by ilie Nttioiuil AflMMmtnt of EducatioiMl IVogreM mdicaiM that the growm| tmphasit in public tchoole on 
demontiraied compeienciei in **bMic tkille*' Hm not fttutied in inctoaeed abihtiet to me tboM •kitia in problem aolving. Soe William 
Snider. '"NAEP Hndt Bmic SkUlt Up. Hifher-Oider Skills Lacking." EduemUm W^tk, Bbniary 1999. 



ERLC 



ADVISORY REVIEW DRAFT - July 23, 1990 



48 



A20P2CH2 



Funding far Innovation and Performance (Chaj^er 2) 



Page 35 



Stntegkally, fundiiis inoentim to yield 
and iDDOvitioii ra tdtaaog bitac lidlls miit be mm » 
mve rtui ei tts that yield t hi|^ rate of ictant Oumiij.vmiy 
Imnienee aie pdsed between decisis 
educttion d q iattm c ms or to contiect out with die piAUc 
eAicetion syeiem for beeic sldUi end voctfionil tndmog. 
Widxwt imovttion, CeUf6niit*e public edocetion eyenm wOl 
no longer be **c o iupe Uiiw ^~4gvwie for bneineeMoneorad 
education will be loit.* ^Tcaining on demand^ by the pablk 
sector to meet pcivate aedor needs raises aome piddic policy 
issiies. However, fleaubility by the ed uc aio n qfSMm m 
perfoanance4)eaed i i iwieci'u ig to achieve common objecthrca 
holds die promise <rf mdoog bnsiness-ediication p ai tnei ahq w 
fiscal £ict, notpuUic relations fiction. 



Population Trends 



Adult learners 
served in 

ESL/Civics classes 
will continue to be 
in need of adult 
basic education. 



The univeise of need for adult education basic skills 
services in California consists of two distinct population 
gnnqps. The first group consists of native aduh learners whose 
school tsxpmeace was unsatisfoctory or incomfriete. The 
second group indudes immigrants wbost school experience 
may have been "normal** for their country of origin, but who 
are not educationally prepared for life in the U.S. Widiineach 
of these populations, diere are myriad distinct skills needs, 
educational badcgrounds, attitudes and values regarding the 
prospect of "going back to schoor. 

Where funding policy has been standardized, services have 
tended to be standardized, widiout reflecting carefol ^forts to 
fa^on service interventions that are finely-tuned to their 
clientele. Innovative ^jproaches are needed to tailor education 
services to the characteristic needs, learning styles, and 
educational objectives of these distinct sub-populations. 

Below, die discussion covers first issues related to linking 
funding to performance and encouraging innovation in serving 
immigrants, and seccmd the issues relating to serving school 
dn^x>uts. 

Immigrants. California's adult educatim system has 
recendy undergone tremendous expansion to provide 
ESL/Civics classes to recendy-immigrated amnesty recq>ients 
who neecfed ''certificates of satisfactory pursuit"^ to satisfy 
INS requirements for permanent residence. Unfortunately, 



^ The biefiture thowi ■ fagty cvm mix of bwiinen ednctrion ptftnciihip lad MHho— c workw tdiKtion •fforti. Forihe 
moment, the prinMry comlnMit on byiimoi* wflKMnutt mmtb to be eiie end ability to cepiteUse m-hovee trainint tfTorts. See Oirit 
Lee. *1ndmiry Report 19S9! The 3 RV TniBing, October 19t9 end "TwKtione] Dliaeracy: It*s Your Ptobiem Tooi"' S«pervieoiy 
MMieffainent«J«ie. 19S9. 

^ The ESUCiviee ompheeii on whit policy Mitlyit Mark T^ima, inittally referred to aa "baaeball aiadittm** education itcmmed 
from acomplex interplay of political conaiderationa. Few obaerv en believe diet the 40-100 boon participation in the claaeea 
conatitaie a meaniBgnil oducationa] iniarventton. Conaequently. the ESL/Civici offoringt have not appreciably affected aggregaie 
demand for Englith languafe and literacy coutks. 
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The challenge 
facing California's 
adult education 
system is to 
develop funding 
approaches that 
foster quality 
basic skills 
training tailored to 
the immigrant 
population's 
specific 

educational needs. 



this Kivke entnuon wti achieved at At exMoat of 
edocatMoalgodSy mmay ciict. Now, tbiM nc^y oe v e to ped 
capacky is coneody canrraBring as the "^bolie** of i ni m i t r aias 
secarespennaMMieaUknoesMliflapactfa^^ At 
the same time, virtually all of the adolt leanms aerved in 
ESIX^ivics dasaes wiU oontimie t^ adnh basic 

education* 

Demand for basic edocaiioii services in California for the 
populttioa legalised by IRCA probably amoonis to aboot 
600,000 adolts in need of ESLsnd literacy sidlls.^ Becanae 
this popiilttion is rdativdy yoong, it will be a sonoe <rf 
A>m«nH fof Pnjiiah language and basic dolls education well 
into die 21st century. 

The demand for services will be increased by recent 
modifications to die Immigrstion nd Naturaliaation Semoe 
**family fairness'* doctrine. These modificsiions will provide 
de facto amnesty to anodier 200,000-^300,000 fimily membeis 
of persons legalked under IRCA« 

Finally, die flow immigrants into Califomia is lo likdy to 
slow Since die ^'control*' function of IRCA has been minimal, 
it is likdy diat Califomia's immigrstion population will 
increase by 100,000-200,000 additional adults each year.^ 

Because die skills gsp between immigrsnts with vecy low 
levels of educational attainment and inoeasing wodqplace 
demands is so aidcal, an objective of adult education services 
for immigrants will be learning to leam— an objective dut has 
not always received much priority. 

The challenge ficing Califomia's adult educatim system is 
to develop funding aqiproaches that foster quality basic drills 
training tailored to the immigrant pq)ulati(m*8 ^lecific 
educati(mal needs, including special topic areas such as 
understanding eligibility for available social service, heahh, 
and training pr ogr am s, career orientaticMi, and communication 
skills.^ The challenge is a pressing one because die funding 
iq^»roach rewarded quantity over quality. As the immigrmt 
populatim is assimilated into industties odier than the low-skill 



^This«ttiinMeisbMedonani»iboaolo|y«MdbyEdKimttiii StrvkM Ibr Innamiili aod lUftiiMi,** San 

Frmcitco Hmhiw Riri<t Coowniwoa May 19iS. TfamatiiodDloty ■do0t>coMWv^ apptoachto w Tw ^ rin^ 
j¥^hy^mmwm%tt»wmm%bmicm9^ «otiviiioa i lfaciort,aad pm o«a 1 co«iifiiaiiiacowc wWit 

realMCicMtiiverM^DMit ThtMdimiyor CaUfbma^aMptriamwMiSLUOitdMtdiMioftA^ 
bttdfit aDocfftioa, the SUAO budftt wm amku pa iH, whik geaKinr Mads, pnnurily adult •dMcabon, w«m mntt 

^1 ArecantUrtalMtiMitsdyivpomtelRCAlMhadamodaniea^ OilMr analyan bali«vc 

that levels of iPMi ugrMi onafCiiot|wadychaydft^ Doulaa Maaaev of the Univafnty of aiica|e haa pM 

fofwaida dtacotitottofihooiotkJcow aH ar au o w ifaatiadicat^ Sea Doaglaa Maaaay and F. Oarcio- 

EqMtfia. **lnieniatioiial Migralioii Natwotii**. Sekmet, May I9M. 

Senate B*l! 2441 (TorraaK introdwaad Fabniary 28, !990. aeeka to provide tpecuU tncentivea for the design of a proframio help 
inmigranis undentand aervtee availabiBty. 
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s^cton thitt have tnditioaally inovkled them witfi en^rkyyment* 
denuoftd in qoality ivofk file edn^^ 

Beciuse Califbmtahis thi|ber ntte of mmitnimi thn 
any other state (flud iboot 60 pMceni of the natioii^f Utiao 
unmigiaDts), it wiU ooMiaM to aet naiioitfl s tm d tnh for 
immitiant edocatioo. The todii^ for theae | TO g i an» imwt be 
adjuaied to encouage inpoyarioo and reward qpility 
perfimiiaiice. Imovaooii will be needed for aupport aervice 
needs of lecem inipugrwm in order to reduce immigiant 
student attritioit Ihindiiii innovaiiaaa are also needed to bwSd 
die ability for < :oniiiwim leamiof and to overcome die 
psycholofical barrieia fooed by adah leamers who have link 
experience in any educational aetting. 

wSchool Dropouts. Sdiod dropouts continue to be a 
serious proUem in California and in the nation.. Since many 
high school graduates lade the basic skills required to 
particqMOe soccessfiiUy in the society and the w<»lq)lace« ir is 
fair to assume diat a nnidi hi^ier proportion of sdhool 
dropouts will require some sort of assistance in basic skills 
development duhig dieir wcnking life. 

Many school dropouts will probably require extraordinary 
attention in die form of siqipM service needs. Large portions 
of die dropout population are psychdogically, economicatty, 
and, in some case, culturally under sr Support services 
will be required to integrate personal counseling with basic 
skills development.^ 

Because school dropouts often have a long history of 
"failure" in the educational context, die costs of individual 
learners not achieving dieir learning objectives in die adult 
educati<m setting are particulariy high (irre^)ective of the 
reasons for n<m-conq[)letion). For sdiool dropouts, one more 
failure in the adult education siting may finally eliminate a 
faidy tenuous resolve to continue learning. There is, 
consequently, a strong econmiic rationale for ''bcmus** funding 
for quality control in die form of increasing program 
conviction rates. 



^ DeniMid for worktite educadon for the ttiiiiii|r«U labor force ia already on the apawing. A paitiailakly tfrtereatiaf praa a w mi o n 
made by Rob Cartwrigfat of Teion Fanna, md km Oomez. of the Afrkateal PenoQael Manaieaieiit Aaaociatioo at *V\fricahMral 
Workforce 2000" March U 1990 identifM conmiMUcaiion aktUa for worioera vpgradittf into attpcrvtaory joba in agricalftire aa a 
crvcial naad. 




developi 
Strategic 

and marginal atudeni probl enw . 



ADVISORY REVIEW DRAFT - July 23. 1990 



51 



A20P2CH2 



Funding for Innovation and Performance (Chapur 2) 



Page 38 



Impiicfttions of Social 
and Economic Trends 

iat ftp MCWWn mmMWy OBWHHfli XOf wCuMB wun m 

ridm ma of pMKMMl md CQ§oii^ ddUi md t popiito>km 
with mcTDiamf pmoitioM of 

with ylrill tfw^ff^^wmjf «^[H!^^ff % flff'' tKf fi ffH^ jug jpfift iiJ^ |[ffff 

must be t hi|^ priority fof Ciltfotiiift^s fisidiQg niitogy . 

The tociil ind ccooonttc traidt ditcofied above •■^ iS fflt f 
diat die fimdiiif atiMegy adopMd at^ 
for quality edncttion. b moat coooiiivie tenuis opfNftisd^ 
tnat leapoM lo mnviOQita apocm neeoa. n mnar tiio craan 
uioemivea xor coat enoGUTepeaa ana prograna tnai ineei me 
changing needa of indoatiy and aociety. 

The fimding atrategy win need both to enoovrage xiak 
talcing, diqielling the perceived tlueat of innovation, nd to 
provide atrong inoentivea for qiudix^ aaaumoe. The atiaaagy, 
in ahoit, is one ptraUd to me enhoitatian of maMgameot 
thinkers such as Tom Peters vaho have argued, very 
successfully, to American buaineaa that xiak uldng and ^a 
passion for excellence** art one and the same. 



2.5 Key Findings 



The preceding research and analysis identifies these 
findings central to addressing funding for innovation sikI 
performance: 

(1) The history of perfonnance-based funding has 
been more preoccupied widi Ae assumptimi that 
pr o gram costs must be contained than widi 
e£f6its to assure Ae quality of program 
outcomes. 

(2) There is a growing interest linking instmctional 
performance with learning outcomes. This 
value-added iqpproach is being required more and 
morc.^ 

(3) Measures of instructional performance must be 
equitable and simple to obtain. 



^ The accoiiniabtliiy rapoft cards for school diaincti that ta a feqwiiemant of Propoaition 9% it another raftoction of chit tiend. Sm 
Dawaon. Op. C*n pages 12-13. 
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(4) The q)ecific demmds pUoad on adnlt edocaiioci 

IDOillirBt Oi pnODIMnOO lull luUBI 

^^^^^^^^^^^^^ ^^^^ ^^^^ ^^^^^IL^M^jm^J^ gm^m^mg^g^^^^^ flA^^^^^^MA 

CQCour^ff v concora Mnri09 nwiii* 

(5) Tbe Mods of idiili tewiBii itquirt tiitt fiiHdim 
linked to yttli,iinMMCft nmst mcotttue 
m^iovaiiQats m the qDiliQr of te^^ 
to-servo gioi^M (^^^ • difcounge cimniiig)^ 
perticoliity iimiiigrmi nd echo<d dropouts* 

(6) There are no ready made models that can be 
readily adq)ted for adult and noncredit 
edocatioiL 

(7) Fee-ior-service fonding and nominal 
pexfomumce-lMsed qsproaches do not include 
rewards for meetmg targets or service 
excellence. 

The next section addresses the options to identify, and 
examines test qsproaches to funding for inoovation and 
performance. These options ar^ pre sen ted widi the redization 
tfiat elaborate work must be dcme to adqx diem to adult and 

continuing education. 
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Chapter 3 

Options to Implement 
Recommendation 

Research has identified eight policy options for review and 
consideration. These options are a pragmatic approach to (1) initially 
prepare for, (2) develop analytic models for, and (3) test several models cf 
funding for innovation and performance. 



T, 



his dupter presents a set of optioiis for isnpleaienting 
Recommendslion 2. Tbc retencfa and design aspects of this 
qiproach in tfiis woddng paper wOI evolve aa (1) moie 
research is accomplidied wiA diis and rdsied pc4icy option 
pi9>ers, (2) advisors and administraton cwumeut on die 
options and reconln.:^adation8, and (3) a broader dialogue on 
the issues emerges. 



3.1 Issues and Options 



this ctuqiter identifies nine areas requiring planning 
decisions and examine c^ons within each aiea. (See 
Exhibit 3.1). This paper will evolve over time and should be 
treated as a 'Voric in progress." Readers are encouraged to 
comment regarding omissions and oversiglits are invited. 

It is iiupoitaut to recognize diat the options presented in 
^^is chq)ter are designed primarily for nontraditional education 
where instmctional technology or nmtraditional settings are 
being enq)loyed. While several of these models may apply 
equally to traditional learning, this issue should not obscure the 
need for new approaches to ^ding nontraditional learning. 
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Exhibit 3.1 

POLICY ISSUES AND OPTIONS FOR FUNDING 
FOR INNOVATION AND PERFORMANCE 



(1) Obtain ^legislative Authorization to Test Neiv 
Models 

(2) Adopt the Independent Study Approach as the 
Basis for Nontrtditional Adult Education 

(3) Develop a Cafeteria Plan of Reimbursement 
Options 

(4) Develop a StatisticaUy Reliable Method for 
Measuring Increased Learner Competencies 

(5) Develop a Fee-fbr-service Plus Performance 
Bonus Model 

(6) Develop a Standardized Funding Model Based 
on Value-Added by the Educational 
Intervention 

(7) Experiment With a Cafeteria Plan of 
Reimbursement Options 

(S) Utilize the EifvCanfm to Facilitate Public- 
Private Ventures and Cross-Agency Funding 



For the puipose of this paper "nontraditional learning" 
includes the following: 



It is important (1) 
to recognize that 
these options are 
designed primarily (2) 
for nontraditional 
education where 
instructional (3) 
technology or 
nontraditional 
settings are being (4) 
employed. 



Computer-managed and con^ter-based instruction 
with limited instmctional suppoit other than 
coaching, tutoring or counseling. 

Home-based or community-centered instruction with 
is primarily technology centered. 

Worksite located or worlcplace ohented instruction 
where the employer(s) may pay at least a portion of 
the instructional costs (yymx ventures). 

All forms of distance learning, (e.g. linear and 
interactive TV, corresponden ^e courses, remote 
computers). 



(5) Mobile educational facilities. 



ERIC 



.^5 

ADVISORY REVIEW DRAFT - July 23. 1 990 A20P2CH3 



Funding for Innovatitm and Performance (Chapier 3) 



Page 43 



Presently the 
adult schools and 
noncredit 
community college 
programs are 
funded only on an 
ADA basis. They 
are not permitted 
to use other types 
of reimbursement 
procedures in 
expending state 
funds. 



(6) Volunteer ceittmd leaming itgaidless of the levels 
of techndogy usecL^ 

(7) Settings ifdiere a certified instructor is not necessarily 
always present. 

Odier cases should be added as q)pr0priate. 

The eight options presented below can stand alone. Each 
should be consulered on its own merits as options to be added 
to our current funding systeoL Many of Aese optikm are 
e3q)eriinental. The reason for this is that diis is a realm with 
few guidebodcs. Thus, the first steps should be developmental 
and basic. 



(1) OBTAIN LEGISLATIVE 
AUTHORIZATION TO TEST NEW MODELS 

Presently the adult schools and noncredit cmnmunity 
college programs are funded only on an average daily 
attendance (ADA) basis. With rare excqxion, diey are not 
permitted to use other types of reimbursement procedures in 
expending state fimds.^ 

The mo'^el has been classroom based instruction with a 
certified teacher present. When instractimal tectmologies are 
employed, they are used in leaming lahs or in the classroom. 
Much of the instructional tedinology is of a "'skill and drill"" 
nature used to reinforce other instruction. 

Recent research suggests that adult schools are reluctant to 
use ADA funds to purchase educational technology.^ C3ianges 
in federal adult education guiddix^ now encourage the 
purchase of instructional technology with federal section 321 
fiinds.^ The primary source of diis technology funding has 
been funds from categorical programs (GAIN and JTPA) or 
"soft'* program develofmient resources.^ 

Legislation is needed to permit experimentation with 
alternative forms of reimbursement in nontraditional 
education.^ While this policy testing can be accomplished with 



^ Hiis •ppnMch is neither nontradittonal nor necetsartly technology bMod However, it should be included in this cUstification. 

2 The Community Collegei do fund lelecourws in their mainculation progruns, but not m then- noncradit educadon. 

^ D. Porter. JA. Intili end E Ktisam, Op. Ck. In this study ■dmintitnuofi said ChM they were very reluctant to uae ADA funds to 
purchase matructional technology. 

^ Dr. Ray Eberhard, Adnunistrator of the Aduk Education Unit, announced m April 1990 that the CDE will permit Section 32 1 
providers to purchase technologies guch aa computers, modems, video disc and software but onh for matructional uae. Theae 
purchases can be made without prior sUte aufhorustion. Unfortunately, this did not include requirements for a local tecluiology 
utilixaiion plan. 

^ See D. Porter. J.A. Intili and E. Kissam, Op. CiL, Executive Summvy« page 7. 
^ In ofxier to receive ADA a certified mstnictor must be onsite. 
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Legislation is 
needed to permit 
experimentation 
with alternative 
forms of 
reimbursement in 
nontraditional 
education. 



fedenl adult educatioD fiinds, this source is limited Fuitiier, 

plans for the use of ibc 321 funds have been esta^^ 

next duee yeaii, and these i^ans are commonly lintod to ADA 

resources. 

The need to test alternative methods of funding for 
innovation and perfomunce was set forth by die 1988-89 
Adult Education Adviacvy Committee^ 

State-of-die-art mkrococnputer and video-based 
instructional technologies have only become availaUe and 
a£fc»dable in die past five years. Programs using these and 
odier instrucdonal technologies are liOt easily funded by 
traditional ADA because they are commonly andied 
individually in ""self-paced^ fuhions. Legislative attention to 
the funding issues ndsed by the changing nature of instraction 
is very recent. 

Programs that use instructional technologies have, for die 
most part, paid for them widi non-ADA fonds. Many are using 
older, more limited hardware and software, because of the 
barriers to financing the initial capital investment. 

Evaluation 

More flexible insrracticmal qiproaches must be widely 
available to meet the objective of making the learning of basic 
and other skills readily available and accessiUe to 
Califomians. The goal is to make adult education available on 
an "anytime, anyplace"" basis in order to respond to the 
continuing pressures for basic and other skills learning. As 
noted above, the range of necessary approaches can be 
expected to include: 

* Learning lab instmction 

* Woricsite basic skills instmction 

* Library and other community centered class and 
volunteer instmction* 

* Home and media based insmiction 

* Portable media based instmction 

Machine based learning permits a more individualize^^ and 
flexible approach to instruction and eventually to tutoring. 
Serious research and policy testing with the uses of 



The pufchMc and um of imtnictiona] technology ibouid uke place witfam the context oT m agency or intHtutkm's leclnology plan 
rather than willy-nilly when aoft fundi or end of the fiaca] year fundi «t available. At the very leaat. it ii neceaaary to permit and 
encourage the reipomibk ftnaocuig and depreciation of machine baaed ieammg eqatpment «id loflwafc. 

• Thii II approach it neither nontraditional nor neceuanly technology baaed. However it ihould be included in thii claiiification. 



ERIC 



ADVISORY REVIEW DRAFT • July 23. 1 990 



A20P2CH3 



Funding for Innovation and Petformance (Chapter 3) 



Page 45 



More flexible 
instructional 
approaches must 
be widely 
available to meet 
the objective of 
making the 
learning of basic 
and other skills 
readily available 
and accessible to 
Californians. 



instnictional technology ire constriined by the ADA 
leinibunemem approach. 

Limited leaeaich suggests, for example, that compoter- 
managed instruction provided in an ind^endent study fimnat 
can be supplied at less cost and less time than the traditional 
class-centered tnstroction. However, it is also necessary to 
exfdore (1) under conditions this approach is useful 

(2) i^ch types of learners benefit firom this qjproach, and 

(3) what are appropriate mixes of counsding, coaching and 
instructional siq)poit in conjunction with machine based 
instruction. At die same time, qi^ication of these educational 
technologies requires more initial investmem. 

Exhibit i2 sets forA an informed estimate of die utility of 
current technologies, given the availability of current adutt 
oriented software. It provides a basis for making judgments 
about the proper roles diat technology can play in adult basic 
and secondary educaticm. 

This analysis suggests that major improvements in ^ypUed 
learning technologies are needed to make them apf^icaUe 
across the board for basic educati<m. Program and Si^ff 
Development: PoUey Option Paper on Strmlegie 
Recommendation 9 recommends inclusion of adult education 
(adult schools) in the K-12 focused Educational Technology 
Act. This will be hdpfol in allocating resources and R&D for 
technology centered instruction. It will not provide the 
flexibility to test non ADA organized programs and 
performance based instiucticm. It also calls for public-private 
collaboration on adult oriented software and courseware 
development. 



Prospects for Future 



A growing body of research and experience indicates that 
computer-based and other forms of technology based 
instruction can be effective, equitable and efficient for aduh 
learners with little or no negative experience in traditional 
educational settings. Their use in nontraditional settings has 
not been tested in the civilian sector. 

New advances in these media, especially in the realms of 
multimedia instruction and intelligent tutoring show great 
promise for "anytime, anyplace" instruction for adult learners 
and for an enriched basic skills curriculum. 
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Exhibits^ 

CURRENT UTILITY OF INSTRUCTIONAL 
TECHNOLOGIES FOR ADULT LEARNERS 



Technology Ap|dicatioD: 



EvahmioiiOriiniii: 



Computer MMMd iiumctioo 
CompulcT bMtd UMlni^ioo 
Compoter fni i f M intcnictioo^ 

VidMdiics: 

PUyiMck 

Intmctive^^ 
Vii5«odiics 

Word prucetion and pnntars 

Pamt and gnpSuct software 

Spieadibeets and fist fiie 
dafabaaaa 





Mefiil 



Utefal 



Not 



Without the ability to test these methods, it will be difficult 
to know under what conditions adult education can be made 
more effective, equitable, or more cost efficient. 

(2) ADOPT INDEPENDENT STUDY APPROACH 
AS BASIS FOR NONTRADITIONAL INSTRUCTION 



The independent study approach establishes a mentoring 
relationship between a learner and instructor* This 
relati(m^p, based on an action plan or negotiated work plan, 
is carried out by the learner under supervision and coaching 



' The policy option paper on Prpgrmm mmd Si^ffDt rmisp miemt mchidet a flooary of technology relaied terms. Compater manayed 
instniciion (CMI) it utmg the computer at the oeniral hatmt in intttuctioa permittiM the compater to pretaat compataociaa, aelaci 
leammg levelt, mttruct and mewire co m pf ehtaa ionofpaiUcatoraieaeof ieamin|. Tm an aeveral computer maaagad inatnictioa 
progrmi that include lower level ESL that have jmnreeeed (he paper't auihon. "Aev include couraewaie firanchiaad or aoM by U.S. 
Batict. WMhm|ton D.C «id die Computer CunrKuium Corporation, Palo AHo, Cahfbmia. Thtt it not an endoraemant, but they are 
worthy of exammation. 

The video dttc interacts with a microcomputer to respond to the users cues, infoimauon searches, snd developmenul activitiea. 
It serves as an exciting simulation medium. 
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The independent 
study approach 
establishes a 
mentoring 
relationship 
between a learner 
and instructor. 
This relationship, 
based on an action 
plan or negotiated 
work plan, is 
carried out by the 
learner under 
supervision and 
coaching from the 
instructor. 



firom die msouctor. This plan becomes a sodal contract tfiat 
can be reviewed, modified and used as the bcnc im aits for 
monitoriiig performance. A goodplan presumes obUgatioas on 
the part of the learner and mstnictor. Untfl leoenlly, 
independent stocfy was not permitted in adult schools except in 
the case of concunem enrollment. This has been relaxed in 
1990. 

This qjproach comes firom enq>loyment and training 
programs. Prevocational and vocational piepanition have an 
individual focus. A usefal examine is the student who eyrie s 
out much of his or her learning in a learning lab aettiogt 
drawmg on text and research tools to support conpiter 
managed instruction. The co mputer managed instruction is the 
core of the learning and enables die leamer to progress her 
own pace. 

The instruaor monitors diis progress, woiks with the 
leamer on siqpfdementary assignments and practi ce, and 
coaches her m areas of apparent difficulty. Group centered 
activities that enable die learner to discuss, e3q>lain, defend and 
con^>are learned per^)ectives and experiences are cradal to 
this $ppro$^ In fact, if diere is a potential shortcoming for 
die ixidtfCDdem learning model, it is the tendency to niinmiize 
group discussion, group projects, and the fonnation of higgler 
order cognitive skills. 

Since the setting is not classroom based, it is difficult to 
determine die basis for ADA. Time on task, measured by die 
con^ter managed instruction system, is the core part of 
learning. Ofifsite research, counseling, group discussions, and 
reading all form part of the ^'learning time*' as it does in 
traditional educatixni. 

ADA reimbursement is less beneficial to the provider when 
leamer participation is interminent (as in a lab setting). Since 
each student devises his or her learning plan, it seems that 
"obtained con^encies " is a better basis for reimbursement. 
Using the EduCardfu as the basis for reimbursement for 
"obtained con^encies" seems preferable. 

The basis for this approach comes from the conventional 
wisdom on adult learning. Andragogy is a term, a concept and 
a rallying cry against the use of didactic, authoritarian methods 
of school based instraction. Malcolm Knowles describes 
andragogy as a set of assumptions that define "the art and 
science of helping adults leam, in contrast to pedagogy which 
is the art and science of teaching children.**^^ These 
assumptions serve as the basis for the core perspective and 



Hekmng to iewn vermi tetchini is the hmu: opertdoiiAj difference. Knowiei dwtingiiielwa, ponibty incofwctly. liuit Ihcte are 
age beaed Malcofan Knowlea. The M^dtrm FrmeHet 9fASmlt Edm^ticm: From Ptdtigogy to AmSfnogy. Asaociauon Preta. Foiled 
Publtahtng Company, Qncago. t9S0. pafes 4(M5. 
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consequently the orthodoxy on adult learning. 
a;>d^'^in)ption$ are: 



These 



Adults are 
aware of their 
specific learning 
needs determined 
by real life tasks 
or problems. 



• Adults desire and demonstrate a tendency towards 
self-directedness as they mature, dioagli they may 
be dqpendent iri certain situations nd conditions. 

* Adults' e3q)erienoes are a rich resource fmr learning 
and teadiing odiers.^ Adults leam more effec- 
tively duxm^ eiqperiemial techniques of education 
such as disoQSsion or problem solving. 

• Adults are aware of dieir specific learning needs 
d^ermined by real life tasks or proUems. Adult 
education pr^^rams should be organized around 
**life applicaticm'" categories and sequenced 
according to learners' readiness to leam. 

* Adults are conq)etency based learners in that they 
wish to $pply newly acquired skills or knowledge 
to their immediate circumstances. They are 
therefore ""performance centered** in their orienta- 
tion to learning.^ 

Recognizing that adult learning is voluntary, requires 
administrator and curriculum designers to shiq>e the curriculum 
to fit these basic precqpts. 



Evaluation 



This recommendation distinguishes between adult learning 
as a class cratered activity and learning as an individuid 
activity. The independent study qiproach is being used in 
adult schools and in some employment and training programs. 
Its tqjplication in the community colleges is less certain since 
the ""class** basis for all instruction is very strong. 

The independent study iq)proach defines the role of the 
instmctor as a facilitator and coach working with each 
individual learner independendy, recognizing learning style 
differences, differences in background and differences in 
learning objectives. Ideally, the use of instmcticmal 
technology, panq>rofessional and/or volunteer assistance will 
enable the instmctor to perform this role. However, it 
presumes diiKeient skills and a different learner-mentor 
relationship. 



1^ The "empty veuel** concept ghouU be diire|arded for my form of educMkm, yet is a difTicuIt trip to ivoid. 

In Califomw and other Uam^ much of the school baied adult education uaea the competency baaed approach. One good 
resource on competency baaed leating and oducalion is the Comprehemve Adult Student Assessment System (CASAS ). 2725 
Congress Street. Suite IM, San Diego. California 921 10, 
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In the ca$e of ESL and basic education, die nde of group 
interaction practice, discuanon, and piojecta camoc be oveily 
streaaed. Tbe quest for asytiiiie, anyplace learning to 
opportunities fbr all learners can conflict widi dus need for 
group interactioa. This is ^ conceptual area that should be 
debated and monitored widi care. 

Prospects for the Future 



Opportunities to 
use and develop 
these cognitive 
skills should be 
readily present in 
an adult basic 
education 
curriculum. 



Substantial in y r o yenients in instnictimud technologies are 
forecast Expert tutoring syatenis will be able to tailor leamirig 
to fit die uidividual. These improvements will not be 
""Disneyland leaming*" but practical, mformation ridi teaching 
environments diat caimot be matdied by traditional modes erf 
classroom instruction. 

The 1990*s will be a time of tremendous diange in the 
knowledge of and the approaches to cogriidon and "^learning to 
leam.*" These changes can be easily incorporated into die 
indq)endent study ^)proadi. Inchiding cognitive sldll 
challenges in curricula stimulates the aUlity to compare, 
syndiesize and to synergize information. The devdopnoent of 
learning process skills are baaed on these intenelated activities: 



Observing 
Qassiiying 
Inferring 
Predicting 

Making operational definitions 
Time-space relationshq>s 
Formulating and testing hypotheses 
Interpreting data 
Fomiulating revised models 



When organized in a stmctured fashion, these activities 
promote problem solving, solution seeking, decision making 
and critical thinking. Opportunities to use and develop these 
cognitive skills should be readily present in an adult basic 
education curriculum. It is these process skills, often referred 
to as critical thinking skills, which form the core steps of 
learning - while the leamer*s background and experiences form 
the learning crucible. 
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This blmding of topkal and hi^ier order dunking ildlb 
can be blended in the indcpmdemsmdyim^ Icwillxequire 
refbcuaing staff and program devdoproent. 

The ability to rqndly reimbiuae providers for individual 
conq)etenck5 gained by using the EduCard^ as die portable 
database will enhance tfie popularity of this ^jproadi. 



(3) DEVELOP A CAFETERIA PLAN OF 
REIMBURSEMENT OPTIONS 



As more flexible 
and appropriate 
methods to fund 
nontraditional and 
innovative adult 
and noncredit 
education evolve, 
new bases 
for determining 
costs and 
reimbursement 
will be required. 



The cunent ADA funding basis is set uniformly for sdKxd 
districts, regardless of the actual costs of instmctian,^ 
However, as more fleziUe and appropriate mediods to find 
nontraditional and inn o va t iv e adult and noncredit education 
evolve, new bases for detennuung costs and reflnbursement 
will be required As more flexible and q)pKopriate methods to 
fund noniraditional and innovative aduh and nonaedtt 
education evolve, this will require new bases for determining 
costs and reiriibursement This is especially the case ynhtn 
machine based instraction is a major mode of learning, when 
instructicm is provided in nontraditional settings. 

Increasing attention to adult education by a wide variety of 
federal agencies and businesses will make it necessary to nuke 
use of more diverse funding sources. If state funds are to be 
used to leverage and capture this potential revenue stream, 
providers must be allowed greater flexibility in cost allocation. 

New methods will be needed to detemiine equitable 
allocations of costs under varying conditicms and to detennine 
what constitutes a fair system of reimbursement. The basic 
costs that must be reviewed include: 



Labor and personnel 

Equqment and equqmient replacement^^ 
Supplies and instructional materials 
Facilities 

Transmission (if distance learning) 
Utilities 

Overtiead and other fixed costs^^ 



^^Oneynttof ADA«qiMli523MidMtt«iteiidmotbom Thwe ait thfee CyM of ADA: actul, aUowabie and fundable. Aciaal 
ADA w die number of itiMteM ADA hMirt actually aanwl by a achool dktrkt llie allowable ADA k the maxiniwn level the etate 
willfimd. ThefimddbleADAwdieleaaarof"actiial"or**aflofwabk"ADAM^i*«^^^ Actaal ADA r baaed 

onihetoialhoinoriiia(nictioneafiiodneachord»laa See Dawaon. CIt. pafea 1 1-13. 

^^TradilMcialaMouiitkgmelhodaaUewthadeprad OtrronUy no more than five yean can 

be die expected yeeful life of raalnictionai compvlar bardwaic and aofrwwe. lliia rale of thumb diould be iupponed by inventory 
manafement prooedaraa that idonttfy purchaae dftiea tod aofcware <fetaili. 

Overhead rates afetreaiedaaitandani fixed rates or nego^^ 
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Increasing 
attention to adult 
education by a 
wide variety of 
federal agencies 
and businesses 
will ntake it 
necessary to make 
use of more 
diverse funding 
sources. 



Dififeiem modes of instruction will have substmtial 
variations in the costs of instruction, all of iN^udi most pass 
accounting and legidadve scrutiny, procedures for calcultting 
and reporting such variations of cost must be developed 
through careful researdi and testing. 

A flexible reimbursement model must be develq)ed that 
can accommodate all instructional modes «nd environments as 
well as traditional classroom centered learning. It is critical 
tfiat Ae procedures specified by diis option be equitidriie but 
relatively sitiq>le to ddSne, doaunent anid wpply. 

There are different methods to reimburse institutions and 
organizations for ^ provision of public services. These 
methods include: 



• Fixed price (fixed unit price — ^ADA or fixed 
total price — straight bid) 

• Cost reimbursement (reimbursement for actual 
costs incurred wiA a set ceiling) 

• Fee-for-service (rou^y the same as cost 
reimbursement but with a negotiated cost 
ceiling) 

• Nominal performance based (JTPA and value- 
added) 



Outside of policy testing and experimentati^m, there are no 
2q>parait models that reimburse service providers based solely 
on their perfonnance. T ere are many reasons for (Thief 
among tfiem being (1) the potential risk to providers if targets 
are not met; (2) the initial difficulty in planning under these 
conditions; and (3) the difficulty in obtaining tfie necessary 
data and consensus on what constitutes iqpprophate measures 
of performance. This is especially the case in an open 
entry/open exit environment. 



Evaluation 



It is feasible to design flexible accounting options to fit 
varying instructional delivery q>proaches. These options must 
be neutral and not inherently favor one instractional approach 
at the expense of others, lliey also must permit providers to 
plan for and recover their investment and instructional costs 
including their investments in plant and equipment. 
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policy testing and 
experimentation, 
there are no 



apparent models 
that reimburse 



Outside of 



It is very im p ortant Aat these acarantiiif opdom do not 
inadveitendy di fcrinu i iitt against die lower lev^ or haid-to- 
serve adnh leanier. In fBCt, th^ should poientialty reward 
providen seeking to serve die most edocatioually 
disadvantaged learners. 



service providers 
based solely on 
their performance 



Fine tuning die models will require die involvement of 
provideis to insure diat die model wiOl, in fact, provide them 
die flexibilhy Aey need to ddiver quality services and to best 
leverage collateral funding. 



Prospects for Future 



Several conditions are necessary to fully realize this option 
(See Exhibit 3J). These include coses on pr^ram 
perfbnnance, underwriting options, ttid empirical assessments 
of die educational achievenmt of die various types of learners 
under different modes of instruction* These preconditions are 
not absolutely necessary to the development of a flexiUe 
reimbursement system. However, they are needed for its fine 
tuning. 

Exhibit 33 

CONDITIONS NECESSARY TO REALIZE 
A FLEXIBLE REIMBURSEMENT APPROACH 



(1) More accurate data on provider peiformance 
(Option 4) and a standard system of collecting 
such data that provides a value-added 
assessment of learner gains. 

(2) Freedom to underwrite the uses of educational 
technology is needed* 

(3) Empirical assessment of the conditions under 
which various types of le^imers perform the 
best under different modes of instruction. 



Ultimately, in^)rovcments in expert system and decision 
support software may make it possible for adult education 
providers to optimize their combini^on of instmctional 
techniques, support services, and learning tectinologies for 
different popdations and specific educational objectives. 
Flexibility in cost reimbursement is necessary to take full 
advantage of increasing ability to tailor adult education 
programs to meet local needs. 
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(4) DEVELOP A STATISTICALLV RELIABLE 
METHOD FOR MEASURING 
INCREASED LEARNER COMPETENCIES 

If feasible, it would be eifiest to letmbufse provider 
perfomMOMt besed on tlie lemer giine— pre^oet test using 
agreed upon attftiii i fi!! measmes. This piesuines that lower 
level leamen as a group learn about tbe same as higher level 
learners and diat there are no significant learning differences 
among demogiiifihic subpopulations. However, it is not dear 
whether diis assumption is correct. 

The rneasurcmcm of learner perfomianoe and co n se que ntly 
the perfcnmance of tbe pcoifider inust be based piiniarfly on the 
knowledge gains of die learner. It is not sufiQcient to measure 
performance based on a state average, die highest levd score 
gains, or on measuirs of learning gain ^diich discnminaie 
against subgroups. This is eapecially the case indm lesming 
gains form die basis for provider reindmsement. Leamerscan 
be profiled imo sub^^oqis for ststistical purposes, {e.g. age, 
sex, pretest scwe, edmicrty, learning objectives). Such 
breakdowns will also pennit assessments of how difiGerait 
types of learners fimction within different modes of instruction. 

It is necessary to devdop a statistically reliaUe profile of 
subgroups of the adult education learners in California and the 
expected learning norms for selected subgroiq>s.^^ This is 
acconplisbed (1) selecting a geiierally accqnable 
performance measure, (2) selectmg a smqde large enou|^ to 
distinguish different subpopulations of adult learners in a 
statistically reliable fashion, and (3) conducting pxe/post 
testing of a saiiq>le of learners to determine learning gains 
(instmcticmal value-added) by statistically identifiable 
subgroups.^' 

The resultant profile will pennit administrators, planners 
and policy analysts to measure relative instmcticmal 
performance-based on the actual mix of persons served and 
conqMure the provider's performance widi the state average for 
die particular subgroups. These data can also provide some 
guicbnce on the relative alternative modes of instraction or 
instructional strategies, though they will not be definitive. 

If there are significant statistical differences among 
learning groups, these state norms could serve as the basis for 
measuring performance for a given time period. They can 



It is necessary 
to develop a 
statistically 
reliable profile of 
subgroups of the 
adult education 
learners in 
California and the 
expected learning 
norms for selected 
subgroups. 



^'^ Thit initidly applies most especially to ESL. aecoiidvy education bask skills* elementary school level basic skills, and possibly 
vocational ed u cation. 

t' While it is far simpler to messnre perfbimancc by kamer gains snd reimbMW accordingly, this csn lead to the problem of 
ovcriooking or avoiding the hard to aerve learning populations (r g. nonliterale native language, special education) becaaoe the 
retmburaemenis will be leas. Rather it is more useftl snd fair to deteimine reimbursemem approaches based on the expected learmng 
gains for these vsrious learner gfoups. 
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chaDfe die nett tiir . ifae sunpltnf ocoan. In the evem ditt 

there >ie ncK t ^ j ftawf d M fc^^ 

subgroapft increues in toming faim would serve as the 

measures of value-added and peifonnance rewarded 

accordingly* 

For tJLmpLe^ the ABE nd ESL programs in aduh schod 
"A"* in the San Joaquin vaUey serve 30 pcfcent monolingual 
Spanidi making adults bom in die United States, 40 pereem 
limited &iglidi fp^Hrf immigrants bom outside of the 
United States, and a mix of odier subgroups of English 
language sp^cm. On d)e odier hand, community coU^ 
district HB** in die Los Angdes basm nuy serve 33 percent 
mondingual Vietnamese qpfairing women, 15 percent sin^ 
Black women bead of households (not in GAIN) fimcdotting SI 
the dementtuy level, 20 percent Eng^-qpeaking Mexican- 
American high school dr opo uts and various other subgroups. 

If diere are significant learning gains difleiences among 
these subgrotq)s, it is iny or tan t diat die perfbmiance of 
provider ''A** is measured against a statewide avenge of 
learner gains (value-added) for die particular subgroiqM it 
serves and die same widi provider "^^^^i^ Iti diis exttOfde, let 
us sappose diat die overall outcomes for its learner groqw are 
bdow sampled average for provider ''A'* whilii provkter ''B'* is 
above average. Prov^er A"* receives either titrgeted tedmical 
assistance or odser support to improve. Provider^** receives a 
bonus commensurate with dieir above average performance. 

The precise dedsicms about wh&t constitutes performance 
rewards and technical support would be defined within die 
other options which follow. 

In order to generate die information needed for this 
performance benchmarking, it is proposed diat the Adult 
Educatim Institute for ResMrch and Planning conduct periodic 
randmi sanq)ling of adult learners ddll assessment tests from 
an adequate sample that would pennit statistical analysis to 
provide sufficiendy high levels of ccmfidence regarding rates 
of gain (value-added) for definable subgroups of learners.^ 

Measurement of program performance via learner skill 
gfiins is being used by an interstate consortium of cmnmunity 
colleges to examine d^icir perfonnance with respect to student 
transfers to four year colleges. Initial analysis revealed that 
there are significandy different demognphic profiles of 
community college transfer populations and providers — ^from 
very aflQuent suburban settings to very poor urban 



This approMh wm Mf|MiBd by Daniel Weikr, Partner, Bemian, Weiler Assocuies, Berkeley. Berman, Weiler AMOCtaiea it 
refining this method m a prq|ect to determine lelative commvmty cotiege to four year college tranefer relet in a mehi-tuie experiment 
with commumty college diemcta. 

^ How the tubgroMpt ait defined would be decermmed in the ttatittscal analytit. 
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conuBunities.^ In order to mcftsure effectxveness, equhy in 
measuremem is required to pennit statistical malysis of 
transfer rates. 



Evaluation 



The principle of 
measuring 
provider and 
learner 

performance only 
within the context 
of statistically 
identifiable 
learner subgroups 
is a crucial policy 
decision. 



The principle of nieasuring provider and learner 
performance by i»ey|po8t tests of student sldll adiievennent is a 
crucial policy decision. It presumes significant learning 
difEerences aniong statistic^ learner subpopid^^ It should 
be maintained regardless of the exact dtrections in which 
methods for f indiof for innovation and perfbonance evolve. 
This is especiuily the case if these performance measures are 
linked to rewards, provider rqxm cards, and/or sanctioos. 

The statistical sampling issues associated widi the q)proach 
are well understood The perfomoance measures will be 
derived from public policy and the oulcomes of pdicy research 
and advisory meetings concerning Recommendation 7 
Program Quality Standards and Performance Measure 
activities.^ 

This option is expected to have many positive impacts on 
our ability to plan and provide better educaticmal services: 

Development of a representative statewide database 
on adult learner and subgroup learning gains. 

Development of a statewide report card on provider 
services vis a vis leam^ subgroups. 

Ability to target intervention strategies and shift 
resources to underserved subgroups. 

Ability to project the probable effects of intervention 
strategies. 

Ability to develop cost-benefit models of altemative 
learning strategies. 

Implementation of this option should compliment current 
plans to develop an effective integrated adult education data 
system (sampling can come from the database). 



Prospects for the Future 



Implementing this option can set the stage for developing a 
reli^le and valid set of measures to monitor and evaluate the 
quality and effectiveness of adult education in California. If 



22 



Fred Best e. ai Qumiky Stmn4mrd$ mmd Pefformmnee httmurts: Policy Option Pmptr on Stmlepe RteommomdmHon 7. Op. Cit. 
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selected, it can provide a wealth of informatim for providers 
and policy makers about die nanire of adult education vis a vis 
a set of agreed upm measures. 

(5) TEST A FEE-FOR-SER VICE PLUS 
PERFORMANCE BONUS MODEL 



This option 
entails adoption of 
a funding strategy 
that allows provi- 
ders to recover 
their actual costs 
of providing 
service (which may 
vary from one 
provider or loca- 
tion to another) 
but that adjusts 
the reimbursement 
rate by paying a 
bonus for superior 
performance. 



This option entails adoption of a funding strategy that 
allows providers to recover their actual costs of providing 
service (which may vary fnxn one provider or location to 
another) and adjusts the reimbursement rate by paying a bonus 
for superior perfcmnance. This option could also withhold a 
portion of funding for lower-dian-average performance vdiHt 
guaranteeing a ''floor"" level of reimbursement to manage the 
risks encountered by service providers. 

This approach would pay the provider for its actual audited 
costs for delivering services up to (for example) 85 percent of 
its total costs. A formula that takes into account perfoimance, 
nature and level of persons served, and ifaeir learning gain 
scores — ^value-added— would account for an additi<mal 0 
percent to 30 percent of the total reimbursement. In this 
exan^le the provider can recover from 85 percent to 115 
percent of its actual operating costs per learner served, 
depending on an annual level of performance.^ 



This option incorporates the idea that the actual value- 
added by the educational intervention must be taken into 
account — not stnply the level of costs incurred. In practice, 
the actual value of the educational intervention may not 
always be correlated with the cost of service delivery {e.g. in 
program designs relying heavily on volunteer service). 

There is a limited history of testing these limited market 
models of service delivery. The only paitial examples include 
the JTPA and value-added models reported in this pzptt. The 
difficulty has been in striking a balance between (1) rewarding 
the provider for the successful provision of service, 
(2) controllihg the costs of service provision, (3) providing 
suppon for the less productive providers, and (4) insuring that 
all potential leamers can be equitably served.^ 



lilts poses tome quesUont about when a penon u officially regutered in a program, fiscal year carry o»ers, «id defimttonal 
concerns that require careful consideration. 

^ There are aubstantial policy and ethical diffkultiea in determinuig who should be served in pubbcly supported service programs. 
There is the /fM^r approach where thoae most likely to succeed are tarpcied for service and variations of that sfmroftch. While 
providers will maintaui that those who come arc served, those most difncuh to serve are often the least likelv to know of a service or 
be able to arran^ their Hves to take advantage of the service. See PoIkv Option P%icr 3 CmmmmmHy Admit Edm^Hom Inffmmthn 
S#n'4r**.Ejaubit9.page43. 
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Evaluation 



The actual value 
added by the 
educational inter- 
vention must be 
taken into account. 
In practice, the 
actual value of the 
educational 
intervention may 
not always be 
correlated with the 
cost of service 
delivery (e.g. in 
program designs 
relying heavily on 
volunteer service). 



This option challenges die providers to provide effective 
services ^;^e bearing in mind the needs for efficiency and 
equity. It is the equity concern that may be lost unless 
adjustments for serving die hard-to-serve are included (See 
Option 4). We favor special bmuses for targeting the hard-to- 
serve.^ 

This approach assumes diat providers will take corrective 
action to improve services if diey are loosing money. This 
fiuKling strategy may prove to be particulariy effective in 
communities where learners can choose among several aenrice 
providers or among several types of service alternatives (an 
adult education market place).^ 

It also will racourage providers to consider the uses of 
instmctional technologies because diey are less costly over 
time. Ftoviders who become confident of their learning 
systems, or who have nuuntained good data on persons served 
can benefit fiom this approach because (1) their actual costs 
are covered, and (2) they can make a profit based on their 
success. 



The lack of cunmt data on die success of these programs 
will make it difficult to say whether the learner is better served 
by this q>proach. Much of what is ccmsidered success is based 
on nonscientific assessments, folklore and personal experience. 
By encouraging more flexibility and permitting more learner 
centered instruction, the learner will be better served. 
However, the absence of longitudinal data or data on learning 
retention rates make this, too, an article of faith. 

There is the question of qui bono (who benefits). The 
providers will generally benefit because their real costs 
regardless of their effectiveness or mode of delivery arc, for the 
most pan, recovered. In some communities there will be 
severe pressure to upgrade the wages or working conditions 
(permanent rather than hourly employment) of adult education 
instructors involved in the technology based learning that, at 
least in the short run, can increase the costs of providing 
learning services.^ However, as more instructional technology 



^ The hard to terve are often ovetwhebned by counUeat problema that make enrolling, attendinf and atkkug with teaming more 
difficttlL Perfofmance boout aytiemt must take th» into account OpCioo 3 can set the nonns for servuig the hud to serve. }^nx * 
inducements to actively recruit, eoroll and provide the support services are needed, because there are fewer successes snd the costs of 
service in all likelihood are higher. 

Policy Option papers 3. 4 and S set the initial parameters for s client centered service delivcrv snd informstion system, 
(e.jf Ommunity Adult Education Information Services, 'the EduCard, and the Integrated Aduh Education Dau System). Within this 
system it is expocied that learners will shop for leammg services bssed on svailabte providen. their services, their performance and 
other charactc Utici. In the long nin the actual cost of providing services and the provider s performance record could influence 
learner's dectsioni on programs. 

The conver'ional wisdom suggests when s next generstion or newer form of technology is more effecnve and is about the same 
efHciency (the same or less cost), thst it will become accepted and adopted. Ln the case of mstrvctional technobgy. we feel ceruin 
thst It will become s more central part of aduh basic tesmm^. and the role of the mstrucijr will change to accommodate it. This 
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is introduced and as these technologies improve, they will be 
used nsore and more, reducing or stabilizing the overall costs of 
instruction. 

This is a 'Vin-win** scenario wherein (1) providers can 
recover most of their real costs of service jmvision, 

(2) q)propriate technology can be purchased and dqneciaied, 

(3) instractors can be realistically paid for real contributions, 

(4) providers will have some flexibility in how services are 
provided, Bnd (5) provider can, if diey perform well, even 
make a modest profit. 

Prospects for Future 

This is an option worth testing. It encourages innovation 
and educational excellence while insuring that service 
providers need not encounter unaccq>table levels of financial 
risk. The more clever aiul experienced administrators will be 
able to optimize this q^roach easily. Those who are less 
experienced, will quickly learn how to use it. 

How option evolves is contingent on the resolution of a 
number of legislative and policy issues such as: 

* How adoption of this option in support of non- 
traditional instractional methodologies relates to 
the overall state qTproach to adult education 
funding. 

• Whether funds will be distributed statewide 
based on assessment of need. 

• Whether funds will be distributed regionally as 
determined by assessment of need. 

* Whether funds will be distributed as present with 
historic funding caps. 

For the most part, these are secondary concerns from the 
point of view of policy testing. In the short run, it is important 
to experiment with funding methods that encourage the 
development of diverse and locally appropriate strategies to 
deliver learning services. 



By encouraging 
more flexibility 
and permitting 
more learner 
centered 
instruction, the 
learner will be 
better served. 



the 



igiests that we may expect to beoer utilize uutniclort, be able to pay them sufficiently lo reuin the good ones, and still better i 
eieamer. 
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(6) DEVELOP A STANDARDIZED FUNDING MODEL 
LINKED TO VALUE-ADDED BY 
EDUCATIONAL INTERVENTION 



This is an 
option worth test- 
ing. It encourages 
innovation and 
educational 
excellence while 
insuring that 
service providers 
need not encounter 
unacceptable 
levels of financial 
risk. 



This approach provides a standardized reimbursement to 
the provider for learning services rendered, based on measures 
of how much an adult has leamed-^alue-added. Since 
con^encies can be defined and tested, this ^yproach c«i be 
applied to any type of instructi<m including vocational 
education and the ten areas of adult education. We suggest two 
variations for consideraticm. 

The first variation (Option 6A) is similar to Option 5 
(adjustment of funding in relation to perfonnance widi a 
guaranteed floor) but standardizes reimbursement in order to 
encourage cost-effective service delivery. The secmd 
variation (Option 6B) is a ^'marketplace model** (fimding 
driven primi^y by performance). Other variations may be 
worth considering, and they are invited. 

(6A) Set a Statewide Base Rate 
and Adjust for Performance. 

This approach would set an average per person 
reimbursement for any learner who receives more tfian a low 
threshold of service (similar to ADA based funding) and would 
provide substantial incentives for value-added by instruction. 
These incentives would be weighted to not discriminate against 
the hard-to-scrve learner cr possibly to even favor him or her. 

The base rate would enable the provider to recover some of 
its service costs, but would require it to receive the bulk of tiie 
funds based on the value of instruction. This would encourage 
efficiency, effectiveness and, given the proper design, equity in 
service delivery. 

This variation is based loosely on cost reimbursement type 
contracting that sets norms for pricing. We arc aware of oiie 
experiment using this approach. However, the evaluation is 
not available.^ 



^ The Office of Economic Opportunity in 1969-72 icned a vanation of this concept in a prevocauofial educauon (ABE) program 
using both computers and manual based prograinined learning. The contractor was a private, for profit fimi ^ iUing tp take the ntk on 
this approach. 
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Evaluation 



This approach 
provides a 
standardized 
reimbursement to 
the provider for 
learning services 
rendered based on 
measures of how 
much an adult has 
learned — value- 
added. 



The merits of this option are that good perforniince ig 
rewarded axxl poor peifoimance is not rewarded However, it 
poses several problems for die providers. It may be nxue 
difficult to plan instructional p rograms in this envi r onme nt . 
Providers* initial response may be to favor cosi-cutting over 
increase in educaticmal effectiveness until they detennine how 
best to optimize cost and instructional effectiveness. It is 
difficult to determine how n{>idly this strategy would move 
providers toward die optimal Imlance without an en^irical test 
of the funding approach. 

This approach suffers from the lack of service delivery dau 
on which to make basic cost ft.id benefit calculations. It will be 
initially difficult to set the norms and the value-added 
incentives so as not to punish the hard-to-serve (Optit n 4). 
However, if the base is reascmable and the value-added 
incentives appr o pr iate, both the learner fnd the more effective 
providers can benefit. 

. It is difficult to argue s^gainst measuring and rewarding 
performance . It can be argued that punishing poor 
performance will hinder sen ice in some communities. These 
communities may include those with a substantial at-risk 
learning groups. However, if performance is measured 
according to learning subpq>ulations skill gains from the point 
of entry (Option 4), poor performance, not equity will be die 
issue. 



Prospects for Future 

It is difficult to speculate on the prospects. As indicated in 
Option 3 there are other policy and funding issues that impact 
the future of this option. 

(6B) Reimburse Providers 
Based on Value-Added 



This option would reimburse the provider for learning 
services based solely on a value-added rate schedule. As in the 
previous alternative, the incentives would be weighted to not 
punish or preferably to favor the hard-to-serve. The incentive 
would increase as the value-added increases. 

This option differs from Option 6A in two respects. The 
costs reimbursed would be the provider's real costs rather than 
a statewide norm and the reimbursement would be based 
entirely on value-added with consistently good performance 
permitting the provider to make a "profit." 
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An opdmistk exannple of this q^proach is: 



Experience is 
likely to show that 
there is an 
''optimaV* mix of 
instructional 
strategies, 
technologies, 
instructor skills 
and abilities, and 
management to be 
effective with 
different learner 
populations. The 
providers who 
learn this will 
benefit. 



(1) A provider knows that it can inqnove (on the 
average) a 6th grade level native language 
speaker's reading and writing skills on die 
average of two grade levek with 140 hours of 
instruction* The fixed and variable costs for this 
instruction the average $1,500 including pro 
rated conqniter time, q>ace use, equqxnent 
defxreciation, materials, instmction and coaching, 
limited one on one tutoring, and overhead. 

(2) The scheduled reimbursement for this learning 
increase is $1,900. 

(3) Using historical information, the provider knows 
it can expect to serve about 100 persons fitting 
the 6th grade native language speaker profile 
with the expectation diat 60 will achieve the two 
grade increase (the $1,900). Based on the 
historical and needs assessment information, the 
provider can expect to make a **profit" of some 
$24,000 ($400 X 60). The remaining 40 learners 
will be in a range that will essentially "break 
even" from a fiscid point of view. 

(4) In diis example, the "profit" would be targeted to 
upgrade curriculum or program design, increase 
levels of support services afforded to "at risk" 
learners in the hopes of improving overall 
performance, give bonuses to instructors, or any 
of several other q>proved uses for the funds 
including carrying them over as flexible money 
to the next fiscal year. 

This example suggests some of the policy and design 
issues. Experience is Ukely to show that there is an "optimid"' 
mix of instructional strategies, technologies, instructor skills 
and abilities, and management to be effective with different 
learner populations. The providers who learn this will benefit. 
Others will stmggle. A few providers wUl be forced to make 
substantial changes to meet their goals in a cost-effective 
manner. 

There is littie experience for this approach. It flics in the 
face of the perspective that a public service program not should 
have private sector type incentives and disincentives to 
improve performance or should not be "profitable." 



lERlC 



ADVISORY REVIEW DRAFT - July 23, 1 990 i A20P2CH3 



Funding for Innovation and Performance (Chapter 3) 



Page 62 



The purpose of 
this option is to 
initiate efforts that 
allow the 
California 
Department of 
Education to move 
ahead prudently 
with testing one or 
more of the 
performance- 
linked models. 



Prospects for the Future 

As with the preceding options, the future prospects tied 
to nuny imponderaUes. For the near future, the poUcy i sue is 
whether to test the utilky of this q)pn>ach. 

A madcet-driven funding qiproach has the advantage that h 
increases accountability, lie crucial issue centers on the rate 
at which educational providers can nK>ve from die relativdy 
weak oirrent links between funding and perfomuuice and a 
more con9>etitive funding envircxmient. It is in^xmant to 
determine the feasibility of diis option. 

The alternative to incoiporating market forces into the 
realm of public sector adult educaticHi is increasing levels of 
educational privatization and loss of public and corporate 
support for public sector educational providers. 

(7) EXPERIMENT WITH A CAFETERIA 
PLAN OF REIMBURSEMENT OPTIONS 

The purpose of this option is (1) to initiate efforts that 
allow the California Department of Education to move ahead 
prudently with testing several of the performance-linked 
models, and (2) to obtain support for further testing in a wider 
range of environments when and if state audionzation is 
forthcoming. 

It would be desirable to implement Option 7 in connection 
with the efforts entailed by Option 3. This is because 
adjusting incentives to reward performance for the relative 
difficulty of serving different subgroups of learners can be 
q>proached most effectively by examining service to identified 
subgroups of leamers in different administrative contexts (e.g. 
a performance-linked funding environment and in the ADA 
envirorunent). 

It appears possible that one or more of these models can be 
tested in conjunction with a federal supported native language 
involving educational technologies in unserved parts of the 
state.^ Policy approval from the Interim Steering Committee 
is consistent widi the approval for the technology outreach 
program funded as part of California's four year adult 
education plan. 



Thij presuppoact that the technology bued program will be funded for levcril yean and that the atakeholdera will paiticip«ie in 
this experiment. 
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Technically this q)proval is not required. But it is 
irx^x>rtant to provide broader support for ttie experimentation 
and to nxmitor its progress in conjunction with the refinement 
of the funding for innovation and performance 
recomn^ndation. 

As noted there is experience with the specific models being 
proposed for testing. There is substantial precedent for using 
federal adult educaticm funds to test program models and new 
learning approaches. 

Evaluation 

Option 1 must be adopted legislatively before 
experimentation using state funds is permitted. 

The normal process in policy develqxnent based on long- 
range planning is to test ai^ experiment with new ideas. This 
is in keeping with that approach. 

It seems sensible that a working paper model of the 
option(s) be developed in conjunction with stakeholders. A 
subcommittee of the Interim Steering Committee or an ad hoc 
task force can carry out this assignment. This can be done by 
using the same iq>proach that is being taken with 
Recommendations 3, 4 and 8, but with fewer planning 
resources. 

Development of this option is an inexpensive and 
appropriate use of federal adult education funds. It is m 
appropriate use of state public funds, but prior authorization is 
required. 

Prospects for the Future 

It is important to test these and other evolving models in 
diverse settings that reflect adult education in California 
choosing among a variety of strategies intended to foster 
excellence in adult education. 

(8) UTILIZE THE EDUCARDjmTO 
FACILITATE PUBLIC-PRIVATE VENTURES 
AND CROSS-AGENCY FUNDING 

Key elements in extending nontraditional learning to serve 
learners anytime and anyplace is developing public-private 
ventures and cross-agency funding. Models are now being 
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Key elements 
in extending 
nontraditional 
learning to serve 
learners anytime 
and anyplace is 
developing ^ublic- 
private ventures 
and cross-agency 
funding. 



tested for worksite, wodq>lace and employee literacy training 
that combine die resources of employers and adult educators.^ 

Cost sharing and reimbursement mediods are an important 
aspect of these coUabraative arrangement. Determining 
instructicmal perfcmnance or valtte*added is anotfier. The 
issues identified in this paper cover most of the subjects to be 
resolved in mgotiating diese public-private and cross-agency 
arrangements. 

The EduCardyu ^ ^ mechanism to facilitate the 
monitoring and reimbursement for value-added instruction.^^ 

The Adult Educaticm Access Card {EduCardj^) is die 
symbol and the tool to facilitate the lifelong learning concept. 
Leameis entering paxtic9>ating programs or (evemually) 
graduating from or leaving high school will be issued an 
EduCard^. 

Information encoded on the card will teU the leamer and 
the provider the person's educational record, eligibility for 
alternative programs, and certification of demonstrated skills. 
This encoded informaticm which can be updated as qjfxopriate 
will (1) simplify paperwork, (2) reduce administrative costs, 
and (3) make more sensitive leamer, service, and labor market 
information available. It will expedite linking private funds 
with public resources. An example follows: 

An adult education provider and an employer wish to 
establish a worksite literacy and ABE program fox en^loyees. 
The program will be offered on a voluntary basis with leave 
time permitted for part of the instraction. The employee is 
expected to voluntarily use additional time. A con^uter- 
managed instruction program is established at the worksite, and 
a basic curriculum proposed. Tht cost sharing arrangements 
between the provider and the private sector participants are 
negotiated stipulating that when each leamer is tested and 
certified as conq>leting a given competency or benchmark, the 
information is recorded and the employer invoiced. Learning 
increases for each participant are rewarded regardless of 
whether die top benchmark or goal is realized. 

This progressive invoicing is rqjid response, yet based on 
measured achievraients.^ Both the computer management 
software and the EduCard-^ can be used as the medium to 
record progress as can other agreed-upon assessment measures. 



^ JTPA and federal adult education fundi are being uaed to teat theae approaches. A body of literature is begtnnmg to appear on 
thesub^L 

See E4mCm4^mk Edmcmtian AccttM Cmrd. Ppiky Option Pmper cm StnUgie RMmmtndotion < Adult Education Insutule 
for Reaearch and Planning, Sacrmcnto, California, March 4, 1990. 

^2 A variation includes the EduCard bemg uaed as an access card to the lewmng lab as well as the mediufii for recording individttal 
perfonnance. This aecure lab setting could be available 24 hours a day. 



ERIC 



77 

ADVISORY REVIEW DRAFT - July 23, 1 990 A20P2CH3 



Funding for Innovation and Performance (Chapter 3) 



Page 65 



This progressive 
invoicing is 
rapid response, 
vet based on 
measured 
achievements. 



This reduces P4>erwoik and mibles the instrwtor to 
individualize instruction based on individual learning plans. 
Since ptfticqMOion is voluntary and enipdoyees attend at 
different intervals and widi diffierent regularity, Ae EduCardj^ 
serves as the portaUe database to determine initial 
competencies and record learner progress. 

There is a growing body of experience with this approach. 
Stumbling blocks are: 



Location of the training 

Mediods for determining cost and reimbursement 
Curricula and stafif requirements 
Flexible scheduling 

Making the program voluntary and non-coercive 

Methods to individualize instruction 

How to avoid creaming 

How to address special education 



Using computer managed instruction, supported by group and 
coaching activities will probably begin to make these activities 
more feasible. 



Evaluation 



lERlC 



In the shon run the EduCardru has the advantage of 
permitting the leamer to build his or her skills at multiple sites, 
presuming general agreement on performance measures and 
benchmarks. The rewards to the leamer and to the provider are 
tied to performance, not to tiiae on task. The card also serves 
as a portable resume of certified achievements that the 
employer can access with the cardholder's permission. 

In the longer run the EduCard^ can be a kind of debit card 
with employers contributing to a training fund and the funds 
debited to the provider's account as specified training is 
completed. This example operates within the context that 
Califomians have the right to a high school education and that 
the public sector will underwrite some or all of these costs, 
even in a woilq>lace setting, as circumstances permit. At the 
same time employers have other work skills requirements that 
education providers can flU more readily than the employer's 
human resources personnel. In this case equitable 
reimbursement is required. Again the EduCard^ can reduce 
the ps^rwork, record progress, certify accomplishments and 
facilitate reimbursements. 



75 

ADVISORY REVIEW DRAFT - July 23. 1 990 A20P2CH3 



Funding for Innovation and Performance (Chapter 3) 



Page 66 



Prospects for the Future 

Ceitifying prior learning and achievements is difBcult. 
Continuing education^ dKmcoorseSt q)ecific training, and basic 
education achievements all occur and are recocded by the 
provider. Yet it is the learner diat needs this evolving record 
has she or he goes dmmgh life to avoid repeating instruction, 
to document achievements and to take advantage of 
mtitlements. TheEtfuCor^isanideal way todothis. 

Life long learning, the need for continuing training and 
retraining and skills upgrading are highly probabte for 
everyone seriously engaged in the information society. It is 
likely diat programs like the En^loyment Training Panel 
(ETP) will become more prevalent wtSm funds are dttocated 
to pay for training or maining. These training accounts can 
be seen as entitlements and can be used to maintain or improve 
skills. The EduCardm can record these entidements, anr* Jebit 
them as the learner draws against the account for training. 

The EduCardm learning account is a metaphor for life long 
learning where the leamer develops skills and interests in a 
marketplace of learning opticms. lliis is a partial vision of the 
21st Cratury. 



Pros and Cons of Alternative Approaches 



This section will present criteria for evaluating the 
proposed options and explore the pros and cons of each. 

CRITERIA FOR EVALUATION 

To develop criteria for evaluation, the objectives of 
Reconunendation 2 (See Exhibit 1.2) have been combined 
with the conditions necessary to realize a flexible 
reimbursement approach (See Exhibit 3.3). These criteria are 
presented in Exhibit 3.4. They frame the following analysis 
and are used in a cross-matrix analysis (See Exhibit 3.5) to 
estimate each option's impact. 



The EduCardfM 
learning account 
is a metaphor for 
life long learning 
where the learner 
develops skills and 
interests in a 
marketplace of 
learning options. 
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Exhibit 3.4 

CRITERIA FOR EVALUATION OPTIONS 

(1) STRENGTHEN ACCOUNTABILITY: 

• Develop reliable basis for evaluating 
provider performance. 

• Generate the information needed to 
optimize instructional strategies. 

• Test the effect of performance incmtives. 

(2) FACILITATE ANYTIME, ANYPLACE 
LEARNING: 

• Reimburse on a flexible l)asis to allow a 
wide range of alternative service 
methodologies. 

• Reward providers for adapting to learner's 
individual scheduling and transportation 
needs. 

• Encourage alternative service delivery 
systems that maximize efficiency and 
equity. 

(3) ENCOURAGE PUBLIC-PRIVATE VENTURES 
AND CROSS-AGENCY FUNDING: 

• Tailored to learner and employer needs. 
^ Leverage new resources for financial 

support, program and learner support. 

• Test innovative approaches to closing the 
basic skills gap. 

(4) STIMULATE FLEXIBLE FUNDS ALLOCATION: 

• Promote local planning and needs 
assessment. 

• Encourage providers to invest in improving 
service delivery quality. 

• Target resources to specific and identified 
needs. 

(5) STABILIZE PROVIDER FUNDING: 

• Support program continuity. 

• Stimulate local planning and resource 
mobilization. 

• Support staff development. 
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COST-BENEFIT IMPACTS 
OF THE OPTIONS 

It is difficult to calculate the actual costs of the proposed 
options. Options chosen by the Interim Steering Committee 
and administrators will be analyzed in greater dqpdi. The 
puipose of this pr<y056d e:q>enniental q^proach is to gain 
insight into the prospective costs and benefits of the <^ons. 

Nature and Value of Positive Impacts 

The general nature and value of the positive inq>acts 
expected from each option are sunmuuized below. 

• Legislative Authorization to Test New Models. 
Legislative authorization is required to use state 
adult and nmcredit education funds to test 
methods for funding rKXi-ADA based innovaticm 
and development. This option has a positive 
intact in relation to the evahiatimi criteria 
proposed It is noteworthy that legislative 
consideration of the rationale for diis option will 
serve to introduce key legislative staff and 
conunittees to the considerations undeilying die 
full set of options. These options dut, in gemral, 
highly responsive to ongoing legislative 
concerns regarding increased accountability, 
flexibility and performance. 

• Adopt the Independent Study Approach as 
the Basis for Nontraditional Adult Education. 
This i^roach is in keeping with the 
conventional wisdom regarding the unique 
features of adult education. It stresses die role of 
the individual in learning and seeks to make it 
the centerpiece in all learning experience. 

• Develop A Cafeteria Plan of Reimbursement 
Options. The adult education providers and the 
California Department of Education will have an 
opportunity to reexamine cost accounting issues 
that may either constrain or facilitate the 
provision of services. This option should 
increase the feasibility of anytime, anyplace 
learning, encourage public private ventures and 
improve the targeting of funds. 

• Develop a Statistically Reliable Model for 
Measuring Incr ^ed Learner Competencies 
(Value-Added). We feel that this option is the 
most important of the initial set presented. It 
may take longer to implement than several others 
but provides the basis for equitably detemiining 
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Many ideas 
sound better than 
they turn out in 
reality. Social and 
management 
science are 
sometimes 
confounded when 
they meet 
sociopolitical 
realities. 



perfDimance. This optim should iin|»x>ve 
provider accountability substantially, stimulate 
fiexiUe funds allocation and stabilize provider 
funding. 

Develop a Fee-for-Service Pius Performance 
Incentive Model. This model devdopment 
would begin as a descrq)tive pq)er model, and be 
subsequendy tested. It is a cost-effective way to 
examine changes in puUic policy. This opcicm 
should facilitate anytune, anyplace learning, may 
encourage public-private ventures and should 
stimulate flexiUe funds allocation. 

Develop a Standardized Funding Model 
Based on Value-Added by Educational 
Intervention. This model development begins 
as a descrqnive paper model. It would be 
subsequcsidy tested to detennine its utility, 
effectiveness and unintended consequences. It is 
a cost-effective way to gamine changes in 
public policy. In exjunction widi Option 3, this 
option should improve accountability, facilitate 
anytime, anyplace learning and encourage 
public-private ventures. In our judgment it will 
stimulate flexible funds allocation. 

Experiment With A Cafeteria Plan ef 
Reimbursement Options. Many ideas sound 
better than they turn out in reality. Social and 
management science are sometimes confounded 
when they meet sociqpolitical realities. 
Experimenting with promising policy concepts 
that appear viable, at least initially, is a time 
honored, cost-effective approach. This option 
should have a positive intact based on aU Jie 
evaluation criteria with the exception of 
stabilizing provider funding. 

Utilize the EduCardrn to Facilitate Public- 
Private Ventures and Cross-Agency Funding. 
This option recognizes the growing importance 
of public-private collaboration and seeks to 
facilitate it by reducing the pi^rwork and 
documenting perfomiance outcomes. It is in 
keeping widi the spirit and development of the 
Adult Education Strategic Plan and the 
interrelation of its recommendations. 
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Costs of Operation 
and Ncfgative Impacts 

This subsection will capmlate the costs and negative 
impacts expeaed from each option. 

• Legislative Authorization to Test New Models. 
It is utalikely that there will be negative impacts 
unless die matter, which seems to us 
straightforward, vpeets qiparmt vested interests. 
The costs are ti^^ligible. There diould be no 
negative inq>acts using tbt evaluation criteria. 

• Adopt the Independent Study Approach as 
the Basis fbr Nontraditional Adult Education. 
The Community College System may have 
difficulty with this q)proadi since they operate 
entirely in a class cen te r ed mode. Hiere are no 
implicit costs tied to this recommendation, 
althou^ progr am and staff development 
artivit ^s (Recommendation 9) should reflect this 
shift. 

• Develop A Cafeteria Plan of Reimbursement 
Options. The costs associated with diis option 
are Lhe development of die P4)er model and the 
costs assodimi widi its review and analysis by 
the Steering Committee and state educaticm 
officials. These costs should be considered part 
of the implen«tfntation of die Adult Education 
Strategic Plan. There should be no negative 
impacts based on the evaluation criteria. 

Develop a Statistically Reliable Model for 
Measuring Increased Learner Competencies 
(Value-Added). The cost alternatives rntailed 
by this approach must be d^ermined. Possible 
decision alternatives would be: (1) d^cemiine if 
current skills test data are sufficient to develop 
the sample and profile, and (2) if not, determine 
the co^ts of generating the data. In the short nm, 
these data, may only be available for Section 321 
programs. In the long nm, these data must be 
generated if any attempts are made to fairiy 
assess the relaxive performance of providers. 
There should be no negative impacts based on 
the evaluation criteria. 

• Develop a Fee-for-seri'ice Plus Performance 
Incsntive Model. This is a paper model process 
relying on the outcomes from Option 3. The 
costs associated with it arc ( 1 ) model 
development, (2) review and approval or 
modification by the Interim Steering Committee, 



ERIC 



^^3 

ADVISORY RfVIEW DRAFT - July 23, 1 990 A20P2CH3 



Funding for Innovation and Performance (Chapter 3) 



Page 71 




and (3) review and approval.or modification by 
state education ^fBcials. These costs should be 
consideied pan of the n^ementation of the 
Adult Education Strategic Plan. There are no 
apparent negative iin|>Kts asaociated with this 
qKion. Its effect on stabiliziiig provider fiiiiding 
is uiqiroven or unknown. 

Develop a Standardized Funding Model 
Based on Value-Added by Educational 
Intervention. This is a pq>er nmdel process 
based on the outcomes from Opticm 2. The costs 
associated with it are (1) model , development, 
(2) review and approval or modification by the 
Interim Steering Committee, and (3) review and 
iq>proval or modification by state ecfaication 
officials. These costs should be cmsidered part 
of the implementation of the Adult Education 
Strategic Plan. There should be no negative 
inqpacts based on the evaluation criteria. Its 
impact on stabilizing provider funding remains is 
unprovcn or unknown. 

Experiment With A Cafeteria Plan of 
Reimbursement. Options. The costs associated 
with this option are die special efforts to test die 
funding models, create and in^dement die 
evaluation component and conduct the actim 
research. If die federally funded outreach 
projea is part of this experiment, most of the 
associated costs can be covered through existing 
contracts (Adult Educaticm Institute and 
OTAN).^ A broader test of <me or more models 
will entail new costs that caiuiot be presently 
calculated. There are no negative impacts 
associated with this option. The policy testing is 
done to avoid unintended consequences. 

Utilize tha EduCanlru to FaciliUte Public- 
Private Venture. There are cosrs associated 
with the use of the EduCardj^, They are being 
analyzed in other feasibility studies. However, 
the presumption is that the EduCard^ wiU 
reduce paperworlc and consequendy costs and 
facilitate cost sharing and the documentation of 
learner outcomes. There arc no negative impacts 
associjued with this recommendation, outside of 
MIS related costs. 



OTAN icfen to the Outreach md Technic«l Anatanc^ Network fundod with federal Section 353 fimdt to provide ftechnolof y 
oriented lechnicel lervicet to adult ichooi md other providen. One component of this project ie an ''outreach** cxperimeni, uaiog 
tnitructional iechnotogiei« to lerve native languafe baaic education learners. It can serve as the project lo lest one or more 
reimbursement approaches. 
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ACCEPTABILITY TO STAKEHOLDERS 

The relationship between the Funding for Today^s Needs 
and Funding far lwM¥e^n and Peffonmmce 
recommendations require more refinement. Is the pdicy 
intenticm to reconmiend that ADA be replaced with a 
porformance-liidml alternative? Even if the answer is 
affirmative, change is a Img way off because it requires 
serious analysis and testing. 

However, stakeholders can be divided into three, groiqps for 
this discussion: (1) "haves/' (2) "have nots'\ and (3) a lot of 
**have not enou^.*" Hiving refers to current levels of ADA. 
Each of time groiqps will cmsider the optiras from sli|}idy 
different perspectives. As a whole, they will be quite 
concerned about any policies diat in^pact funding. 

• Legislative Permission to Test New Models. 
Stakeholders, i^ our judgment, would support 
this q)pfoach. They would also si^pon 
leg^ation to include die use of instructional 
tedmology in state funded adult education. 

• Adopt Indepmdent Study Approach as Basis 
for Nontraditional Adult Education. The 
Community Colleges may object ^to this 
recommendaticm on philosophical or practical 
grounds. However, die focus is on 
nontraditional leanuiig. We expect stakeholders 
to accqpt this recomimndation in principal and 
to find practical ways to integrate it into their 
overall instnicdonal strategies. 

• Develop A Cafeteria Plan cf Reimbursement 
Options. Stakeholders would suppoit this 
opdon, aldiou^ they would expect to be 
consulted in its development and refinemoit. 

• Develop a Statistically Reliable Model for 
Measuring Increased Learner Competencies 
(Value-Added). In our judgment stakeholders 
would support this opdon. Ttiey need this data 
also in ortter to analyze their performance. They 
will be concerned about the design, the 
measures, and the costs. There wjU be concern 
raised about too much testing though the test can 
be based on a reliaible sample. The issue of 
teaching to the test has been raised widi this 
opdon. Likewise the question of obtairung post* 
instruction outcomes information can be a 
problem. 

• Develop a Fee-for-Service Plus Performance 
Incentive Model. There is little doubt that 
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stakeholders would support the development and 
refinement of this model. 

• Develop a Standardized Funding Model 
Based on. Value-Added * by Educational 
Intervention, It is not clear whether 
stakdiolders would siqiport this noodel, at lea^ 
as articulated in this paper. 

• Experiment With A Cafeteria Plan of 
Reimbursement Options. Stakeholders would 
support diis <^on as it Mpphes to instruction that 
is dqiendent on conqniter based or distance 
learning teduxdogy. They will be concerned 
about die nature of die model and die policy 
in^lications as a rqdacement for ADA. 

• Utilize the EdMCardr^ to Facilitate Public- 
Private Ventures. Stakeholders would support 
this opticm, enedally in the nontraditi<mal 
settings where flexible learning and scheduling 
prevaH. It will help reduce administrative costs 
and document performance. 



Exhibit 3.5 displays the option;; cross referenced by our 
assessment of their impacts, based on the evaluation criteria. 
Reviewers should consider performing their own assessment 
using this same approach. 



CROSS-MATRIX ANALYSIS 
AND DISCUSSION 
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Exhibit 3^ 
ILLUSTRATIVE CROSS-MATRIX 
COMPARISON OF OPTIONS 
VIA COMMON CRITERIA 



Recommendation: 



Evaluitioo Odieiia: 




(1) UfiiUtmAiitbodtytoTtit 
New Modal! 

(2) Adopt tbelndepeDdcat Study 
ApfNoach for NodtnditioiuJ 
Adub Educatkm 

(3) Develop CafcMui Plan for 
Reimbiuwin«nt Options 

(4) Develop Statistiadly RebeUe 
Modal for MeMoriitg 
locieued Learner 
CoiTipetencict 

(5) Develop Fee-for'-Service 
Peffonnaoce Liceittive Model 

(6) Develop Standardized 
Foading Model Baaed 00 
Vttue-Added 

(7) Esq^eiiment with a Cafeteria 
Plui of Retmburaenient 
Options. 

(8) Utilize the £iftiCar^ to 
Facilitate Public-Private 
Ventuxes 




Degrwe ^Impact, 



impact 



Mfldittan 



Low 



erJc 
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Chapter 4 

Recommendations 

We recommend that all options be selected for further development as 
action items or as descriptive paper models. In action, a new 
recommendation is added that directs the Adult Education Institute to begin 
to build a knowledge base on adult learning theory and how it applies to 
skills development competencies and problem solving skills. 



^Lhis paper additsses fundamental policy issues that will 
guide the development and testing of innovative funding 
q>proaches and models. It lays die gioundwoik for further 
analysis and policy testing. 

The options presented can be reviewed as a gfoup or 
individually. They are jnesented in a. somewhat sequential 
manner. We recommend that all eight options be adopted. In 
addition a new recommendation is proposed. 



4 J Summary and Elaboration of Options 



T.'ie nine options presented and recommended are: 

( 1 ) Obtain Legislative Authority to Test New 
Models 

(2) Adopt the Independent Study Approach as the 
Basis for Ncm-Traditional Adult Education 

(3 ) Develop A Cafeteria Plan of Reimbursement 
Options 

(4) Develop a Statistically' Reliable Model for 
Measuring Increased Learner Competencies 

(5) Develop a Fee-for-service Incentive Model 

(6) Develop a Standardized Funding Model Based 
on Value-Added 

(7) Experiment With A Cafeteria Plan of 
Reimbursement Options 
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(8) Utilize the EduCardju to Facilitate Public- 
Private and Cross-Agency Vennues 

(9) Develop a Knowledge Base on Adult Learning 
and Higher Oitier Thinldng Skills 



4.2 Summary of Selection Decision 



Options 1-4 to sonie extent preclude die full development 
and testing of Options S-8. In this sense, a basic structured 
q)proach is proposed. 

Ejlght of these options have been discussed in detail in die 
preceding chapters and will be elaborated as researdi and 
discussion progresses. For the nxmient, the most im por tan t 
concern is whether the central themes or issues are addressed 
that will permit die Aduh Education Institute for Researdi and 
Planning to begin to refine an initial qjproadi to funding for 
innovation and performance. Towaid diis end a ninth 
.recommendation is added to guide long term background 
research. 

OBTAIN LEGISLATIVE AUTHORITY 
TO TEST NEW MODELS 

In order to fully test models for funding iimovation and 
performance, legislative authority is needed. This ihay take 
some time to acquire. In the meantime, limited testing can 
occur with die federal adult education funds received die 
state or by soliciting other sources of funds: 



j iiii n ^ii m.Hm iii Mj u^i j y i n ii minM i ni ii L i 




ftiOi^'^i^hsvtM^ oift opii^aQe «inie tikis 

Hon -iKrvaV 'Hbt f^wiba^ i^ Ibe iiipRMdi and ebte 
nirintcqdtedoc«»eqpenoeic<iBnot 
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ADOPT INDEPENDENT STUDY APPROACH 
AS BASIS FOR NON-TRADITIONAL 
ADULT EDUCATION 

The indq^endent study q^oach that measures teamer 
progress based cm compe^ncies achieved wiii be usefo! for 
non-traditional education. It recognizes individual tin^ables, 
backgrounds, learning styles and objectives for the learning 
and develops a plan and procedure to address diem. 



The independent 
study approach 
that measures 
learner progress 
based on 
competencies 
achieved will 
be useful for non- 
traaditional 
education. 




and ite iMhBBia^ 



DEVELOP A CAFETERIA PLAN 
OF REIMBURSEMENT OPTIONS 

In ADA based funding, the major expmse is instmctor 
salary and benefits, whedier they are contraa or hourly 
employees. In tedmology centered and nontraditional adult 
education, instructor costs may not account for the major 
expendhures. This depends in part on the instmcticmal setting 
and whedi^ facility and technology costs are shared with K~12 
provide or community college cxedit education, or are wholly 
the adult education provider's responsibility. 
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Learner 
performance 
should be 
measured in 
comparisoij, with 
similar learners. 



The cost elements for this model are known. However, 
when perscmnel and possibly even facilities are lower poitiras 
of learning cost, die overhead costs change and other elements 
will increase coA. A modd that anticq)aies these variations 
and treats diem faidy is the objective. 

DEVELOP A STATISTICALLY RELIABLE 
MODEL FOR MEASURING 
LEARNER COMPETENCIES 



Learner performance should be measured by skills gains in 
con^>arison to similar learners.^ This can be acconqdished by 
devdoping statistical sanqples of learners that are large enou^ 
to include learning subgroups.^ When such a model is 
designed and in place in California, die California Dqpartment 
of Educatim will be able to (1) detmnine the relative learning 
achievements among different learners, (2) reward provider 
performance^ and assist underperforming providers, and 
(3) develop an understanding of what instructional srategies 
work with which learners. 



^ braes lelaied lo tlie validity of the meamiret m the subject of HoHcy Option Paper 7 Prognm Qmdiiy S$9mdmis i 
^ This frottndwork hat been Uid in current pre end post lemer testing with federally funded 321 programs. 
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The utility of this model goes far beyond funding for 
innovation and perfonnance. It can lay tl^ groundwotk for 
substantial state and local planning and analysis. We pfesome 
that adult education will be more and more leamec centered 
and the learning demands more diverse. Data reflecting vnhst 
strategies and what costs are associated witfi serving die 
various learning populations will permit fine tuning appioaches 
to the adult learner. 

DEVELOP A FEE-FOR-SER VICE 
INCENTIVE MODEL 

Authorization is sought to develop a descriptive model of a 
fee-fbr-service (actual costs based on a set of performance 
assunq>tions) incentive niodel. The incentive would reward 
performance if the costs were less tium assumed and/or if the 
leamer poformance meets or exceeds state norms 
(Recommendation 4). This qjproach recognizes the difference 
in costs among providers and seeks a fair return on the costs, if 
there is sufficirat value-added for the instruction. 



lERLC 
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The objective of this, development will be to field test the 
model in diverse settings. However, diis presumes that 
Recommendition 4 data are available and that 
Recommendation 1 has been implemented. 

This model inq>lies tradeofiEs between costs and 
performance that will be unique to each provider and each 
learning group depending <m the nature of the incentives. It 
inn^lies tfiat some provides may q)ecialize more in whom they 
serve. 

To be useful the model must encourage serving tbc haid-to- 
serve adult learner. We have idoitified die school drqxrat and 
the immigrant as two important groups. 

DEVELOP A STANDARDIZED 
FUNDING MODEL BASED ON VALUE-ADDED 

We reconunmd that a descrq)tive model that rewards 
performance based on increased learner coR9)etencies be 
develqped. This develqxnent should occur widi partic^>ation 
from a range of current adult education providers particqiating 
in an advisory or design opacity. These providers can be 
drawn from the Interim Steering Committee's Subcommittee 
on Funding and Subconunittee on Quality Standards and 
Performance Measures. 



ERLC 
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Substanti&l agreement is necessary on what coosthutes the 
param^ers of these models. There are policy issues diat nuist 
be addressed witfi die guidance of adult education 
administrators. Developing diese models as paper products- 
will be cost effective and provider sensitive. 



EXPERIMENT WITH A CAFETERIA PLAN 
OF REIMBURSEMENT OPTIONS 



Some latitude exists to begin to experiment with models 
that stress innovation and peiformance. The drawback is die 
lack of data until Reccnnmendatim 4 is inqdemented. 
However, surrogate data can be developed and small 
experiments mounted using fedoal funds. We recmimaid that 
small experiments be initiated that test these above noted 
models: 



Tv«o «Midfili .itH^''^iHiM^iyQeiflt~featHn« of 
immOm wi^ $ m kmi a) ^ iMfl ^ tested in suudl 

tik^'^ilf^tK^ vkpei dot kotractiooal 

wa«a^l)<kl0^iosi^or would be 
mo^HMQdibove. 



94 
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These modds would be tested after sufBcmK 
devdoproenMl wodL This pttmrnm the approval of 
Recoomeodatioiis 5 and 6. This tesiingt albeit umittd, can 
provide eariy guidmce as to the types of policy ismes and 
concerns dial will arise in a broader experimeitt. 

UTILIZE EDUCARDju 
TO FACILITATE PUBLIC-PRIVATE 
AND CROSS-AGENCY VENTURES 

The EduCardru and die coUdxxrative information stroctme 
are being designed to enaUe die cost efifective cross agency 
transfdr of learners and leaiMrkifonnitioQ. One aqiectof diis 
cross agency collaborate is between die paUic and private 
sectors. The EduCardp^ and its conqittiion cross agency 
management information system will suppon dits 
development. 



The EduCardjtA 
and the collabora- 
tive information 
structure are 
being designed to 
enable the cost 
effective cross- 
agency transfer 
of learners and 
learner 
information. 




Easing administrative arrangements and documenting 
performance will enhance these public*private and cross- 
agency arrangements because they are perfomMnce driven 
raiher than seat time or iiq>ut driven. 

DEVELOP A KNOWLEDGE BASE ON 
ADULT LEARNING AND HIGHER ORDER 
THINKING SKILLS 

While not strictly necessary, it is important to address some 
areas of cognition and learning that have not been a focus in 
adult education. We refer most specifically to developing a 
better understanding on how skills competencies are ^veloped 
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and problem solving dolls enhanced The Adult Educadon 
Insdtute for Reseaxcb SDd Planning should be dtrecied to be^m 
to develop t knowledge baae on tfaeae higher Older leenmig 
skills, especially as they apply to technology baaed 

instruction.^ 



The Adult 
Education Institute 
should be directed 
to begin to develop 
a knowledge base 
on these higher 
order learning 
skills, especially as 
they apply to 
technology based 
instruction. 

This lecommendation requires minimal resources. It 
acknowledges the impcmance in int^ntting hij^ <mler 
thinking skills into conq)etency based education. It also 
acknowledges the fact that learning dieory is changing, 
especially in the area of machine based learning. Attention 
should be paid to these changes. 

This recommendation is made to insure diat this topic, 
while more abstract, is included in the Adult Education 
Institute workplan and that some oversight ocoirs regarding its 
design and implementaticm. We would expect diis knowledge 
base to consist of symheses from bibliognqihic, researdi and 
other published infomutticm and software that relates to 
developing an understanding of adult learning theory and aduh 
learning practice — bodi basic and advaiKed. 



^ The cttfiem interMt in "tezy logk." expert tyttems and intelligent tutors points to new means to support s.;d enhance learning 
and problem sotving in the worlq>lace, leaminf tution and the oommunity. 
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Chapter 5 

Conclusion and Future Issues 

These eight recommendations presented in this paper and subsequent 
development work will lay the groundwork for the design and application of 
funding systems that encourage innovation and performance. 



T^he initial lecommendadons will be itiSned in die nett 
woddng docomems. They will be reviewed by staff and 
agercy heads for their acceptability, and dm adyosied until 
ibsy are acceptable to the heads of die cdUtoating agencies. 

The fttitfier development and analysts of issues rdssed to 
funding for innovation and performance will take two foons: 
(1) on-going research and analysis; and (2) iuytomertin g the 
approved rpcommendations. Ptndiog approval and fiindinf for 
developmental wodc, they will be p erfonned by Adah 
Educaticm Institute for Research and Planning (AEI) under the 
guidance of the Interim Steering Committee and its 
subcommittees. 

Any policy recommendations of the Xnterim Steering 
Committee or subcommittees will be reviewed by State 
Superintendent of PuUic Instniction« Bill H<mig, and 
Califomia Community College Chancellor, David Meites, as 
well as heads of other paiticqpating agencies. 

The most inqx)itant immediate foture issue is linking the 
recommendations among die 14 policy options pwpm to fom 
a coherent whole. Odier future issues of impcmance are based 
on die outcomes of subcommittee, Interim Steering Committee 
and agency review. 

This review and discussicm process is designed as a 
progressive cycle of public comment «id dialogue among 
agency heads. Steering Committee members and Institute 
personnel. 
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